[ 514.203379] env[66827]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 514.203379] env[66827]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 515.221946] env[66919]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 515.221946] env[66919]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 516.774018] env[66919]: INFO neutron.common.config [-] Logging enabled! [ 516.774318] env[66919]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev7 [ 516.774563] env[66919]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66919) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 516.774869] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 516.774973] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 516.775833] env[66919]: WARNING oslo_policy.policy [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 516.776059] env[66919]: WARNING oslo_policy.policy [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 516.777694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] VMware NSXv3 Agent initialized successfully. [ 516.778048] env[66919]: DEBUG oslo_concurrency.lockutils [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Acquiring lock "singleton_lock" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 516.778304] env[66919]: DEBUG oslo_concurrency.lockutils [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Acquired lock "singleton_lock" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 516.778391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Releasing lock "singleton_lock" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 516.778663] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Full set of CONF: {{(pid=66919) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:274}} [ 516.778773] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ******************************************************************************** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 516.778873] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Configuration options gathered from: {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 516.779230] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 516.779399] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 516.779504] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ================================================================================ {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 516.779666] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] agent_down_time = 75 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.779801] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] allow_automatic_dhcp_failover = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.779931] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] allow_bulk = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780081] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] api_extensions_path = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780217] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] api_paste_config = api-paste.ini {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780353] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] auth_strategy = keystone {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780447] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] backdoor_port = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780546] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] backdoor_socket = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780672] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] backlog = 4096 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780802] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] base_mac = fa:16:3e:00:00:00 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.780977] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] bind_host = 0.0.0.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781135] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] bind_port = 9696 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781265] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] client_socket_timeout = 900 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781433] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] config_dir = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781504] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781624] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] config_source = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781757] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] control_exchange = neutron {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.781890] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] core_plugin = ml2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782032] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] debug = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782165] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] default_availability_zones = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782365] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782496] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dhcp_agent_notification = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782624] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dhcp_agents_per_network = 1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782749] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dhcp_lease_duration = 86400 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.782918] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dhcp_load_type = networks {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783065] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dns_domain = openstacklocal {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783190] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783318] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_default_route_bfd = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783443] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_default_route_ecmp = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783564] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_dvr = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783706] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_new_agents = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.783890] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784040] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_signals = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784171] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] enable_traditional_dhcp = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784294] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] external_dns_driver = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784419] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] filter_validation = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784553] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] global_physnet_mtu = 8950 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784679] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] graceful_shutdown_timeout = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784851] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] host = cpu-1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.784985] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] host_dvr_for_dhcp = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785130] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] http_retries = 3 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785262] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] instance_format = [instance: %(uuid)s] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785392] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785526] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ipam_driver = internal {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785654] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ipv6_pd_enabled = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785781] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] l3_ha = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.785913] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786055] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] l3_ha_network_physical_name = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786187] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] l3_ha_network_type = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786319] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_color = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786447] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_config_append = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786576] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786701] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_dir = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786824] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_file = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.786923] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_options = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787062] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_rotate_interval = 1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787196] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_rotate_interval_type = days {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787323] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] log_rotation_type = none {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787421] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787517] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787648] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787776] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.787875] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788012] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_dns_nameservers = 5 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788140] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_header_line = 16384 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788264] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_l3_agents_per_router = 3 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788392] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_logfile_count = 30 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788518] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_logfile_size_mb = 200 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788641] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] max_subnet_host_routes = 20 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788775] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] my_ip = 10.180.1.21 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.788908] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] my_ipv6 = ::1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789046] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] network_auto_schedule = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789174] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] network_link_prefix = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789306] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789438] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] notify_nova_on_port_data_changes = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789570] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] notify_nova_on_port_status_changes = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789703] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] pagination_max_limit = -1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789830] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] publish_errors = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.789957] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rate_limit_burst = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790106] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rate_limit_except_level = CRITICAL {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790234] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rate_limit_interval = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790359] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] retry_until_window = 30 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790483] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] router_distributed = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790609] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rpc_resources_processing_step = 20 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790734] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rpc_response_max_timeout = 600 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.790879] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] rpc_response_timeout = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791031] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] send_events_interval = 2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791180] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] service_plugins = ['router'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791316] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] setproctitle = on {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791441] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] shell_completion = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791571] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] state_path = /opt/stack/data/neutron {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791704] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] syslog_log_facility = LOG_USER {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791832] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] tcp_keepidle = 600 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.791965] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] transport_url = **** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792106] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] use_journal = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792232] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] use_json = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792358] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] use_ssl = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792481] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] use_stderr = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792637] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] use_syslog = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792732] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vlan_qinq = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792872] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vlan_transparent = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.792999] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] watch_log_file = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.793147] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] wsgi_default_pool_size = 100 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.793276] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] wsgi_keep_alive = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.793412] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.793539] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] wsgi_server_debug = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 516.793685] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_concurrency.disable_process_locking = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.793823] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.793959] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794102] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794238] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794370] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794496] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794640] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.connection_string = messaging:// {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794772] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.enabled = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.794905] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.es_doc_type = notification {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795046] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.es_scroll_size = 10000 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795180] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.es_scroll_time = 2m {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795307] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.filter_error_trace = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795440] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.hmac_keys = **** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795577] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.sentinel_service_name = mymaster {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795716] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.socket_timeout = 0.1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795847] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.trace_requests = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.795977] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler.trace_sqlalchemy = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.796131] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler_jaeger.process_tags = {} {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.796258] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler_jaeger.service_name_prefix = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.796387] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] profiler_otlp.service_name_prefix = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.796530] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.enforce_new_defaults = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.796791] env[66919]: WARNING oslo_config.cfg [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 516.796937] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.enforce_scope = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797090] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.policy_default_rule = default {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797239] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797376] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797512] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797638] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797763] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.797887] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798025] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798162] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_policy.remote_timeout = 60.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798305] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798446] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] agent.extensions = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798581] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798715] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] service_providers.service_provider = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798854] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.default_quota = -1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.798991] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799134] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_floatingip = 50 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799259] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_network = 100 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799384] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_port = 500 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799508] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799634] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_router = 10 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799758] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_security_group = 10 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.799882] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800014] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.quota_subnet = 100 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800143] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] QUOTAS.track_quota_usage = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800284] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800411] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800535] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800660] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800789] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.800941] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801084] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801223] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801348] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801470] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801595] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801724] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801852] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.801979] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_dhcp_release.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802125] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802249] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802371] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802495] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802622] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802750] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.802912] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_ovs_vsctl.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803055] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.capabilities = [21] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803184] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803310] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803437] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803570] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803698] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803824] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_namespace.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.803973] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.capabilities = [12] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804125] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804250] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804376] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804505] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804632] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804757] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_conntrack.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.804891] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.capabilities = [12, 21] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805025] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.group = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805154] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.helper_command = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805283] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.log_daemon_traceback = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805412] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805538] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.thread_pool_size = 8 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805663] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] privsep_link.user = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805809] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.805950] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806098] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.continue_on_failed_promotions = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806228] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.dscp = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806360] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.dscp_inherit = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806494] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.force_mp_to_policy = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806622] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.locking_coordinator_url = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806751] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.log_agent_heartbeats = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.806882] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.logging_expire = 1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807026] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807159] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807296] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.polling_interval = 240 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807426] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807560] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807698] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.report_interval = 30.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807835] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.807973] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808119] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808253] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.sync_skew = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808384] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.synchronization_queue_size = 20 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808515] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT.use_helper_for_ns_read = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808656] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] SECURITYGROUP.enable_ipset = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808796] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] SECURITYGROUP.enable_security_group = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.808935] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809086] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809260] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] experimental.ipv6_pd_enabled = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809428] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.extension_drivers = ['port_security'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809560] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.external_network_type = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809706] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809849] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.overlay_ip_version = 4 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.809990] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.path_mtu = 8950 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810145] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.physical_network_mtus = {} {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810290] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.tenant_network_types = ['vlan'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810429] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810570] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ml2.type_drivers = ['vlan'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810710] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT_CLI.neutron_port_id = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810845] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.810979] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811135] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811273] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811408] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811543] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811680] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.811814] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812017] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812168] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_login_password = **** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812314] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_login_port = 443 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812449] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_login_user = admin {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812586] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812723] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.812878] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813031] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813165] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813308] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813444] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813581] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813712] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.813849] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814012] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814162] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814298] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814489] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814633] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vsphere.vsphere_login_password = VMware1! {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814769] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.814900] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815051] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.auth_section = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815196] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.auth_type = password {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815335] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815458] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.certfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815591] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.collect_timing = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815729] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.endpoint_type = public {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815862] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.insecure = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.815992] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.keyfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816142] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.region_name = RegionOne {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816275] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.split_loggers = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816404] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] nova.timeout = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816536] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.auth_section = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816676] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.auth_type = password {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816811] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.816940] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.certfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817084] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.collect_timing = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817224] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.endpoint_type = public {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817350] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.insecure = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817475] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.keyfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817597] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.region_name = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817722] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.split_loggers = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817844] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] placement.timeout = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.817979] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.auth_section = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818120] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.auth_type = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818250] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.cafile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818373] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.certfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818504] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.collect_timing = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818629] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.connect_retries = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818759] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.connect_retry_delay = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.818891] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.enable_notifications = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819026] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.endpoint_override = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819159] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.insecure = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819283] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.interface = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819408] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.keyfile = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819559] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.max_version = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819741] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.min_version = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.819881] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.region_name = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820023] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.retriable_status_codes = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820151] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.service_name = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820275] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.service_type = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820406] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.split_loggers = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820532] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.status_code_retries = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820660] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.status_code_retry_delay = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820784] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.timeout = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.820936] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.valid_interfaces = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821084] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ironic.version = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821223] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] cli_script.dry_run = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821371] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821505] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821638] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821770] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.821900] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822043] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822178] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822307] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822439] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822578] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822707] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.822846] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823013] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823162] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823295] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823433] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823568] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823701] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823841] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.823990] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824146] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824278] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824406] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824534] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824662] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824787] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.824914] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825054] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825184] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825314] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825445] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825584] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825719] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825849] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.825985] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826133] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.ssl_version = {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826263] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826407] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_notifications.driver = [] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826542] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_notifications.retry = -1 {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826688] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826819] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] oslo_messaging_notifications.transport_url = **** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 516.826925] env[66919]: DEBUG oslo_service.backend._eventlet.service [None req-34851f67-a462-4513-ac2b-4240f2dae672 None None] ******************************************************************************** {{(pid=66919) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 516.828053] env[66919]: DEBUG neutron.agent.securitygroups_rpc [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Init firewall settings (driver=nsxv3) {{(pid=66919) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 516.829360] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66919) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 516.829603] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] RPC agent_id: nsxm-l-01a.corp.local [ 516.831803] env[66919]: DEBUG dogpile.cache.region [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 516.831920] env[66919]: DEBUG dogpile.lock [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 516.832026] env[66919]: DEBUG dogpile.lock [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 516.832116] env[66919]: DEBUG dogpile.lock [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 516.832206] env[66919]: DEBUG dogpile.cache.region [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 516.832291] env[66919]: DEBUG dogpile.lock [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 516.832408] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 516.867888] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Session token - acquiring [ 516.869561] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 516.869722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 516.869826] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 516.870259] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 516.883090] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 517.160256] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 517.185329] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 517.185508] env[66919]: DEBUG dogpile.cache.region [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Cache value generated in 0.353 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 517.185570] env[66919]: DEBUG dogpile.lock [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 517.185699] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Activating Policy API Provider. [ 517.185889] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Looking for the default Infrastructure Rules. [ 517.263717] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Looking for the Default Layer3 Logged Drop Section. [ 517.278018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 517.278504] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 517.278669] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 517.278763] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 517.279059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 517.279432] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 517.794776] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 518.297336] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 518.800212] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Inventory metadata is going to be refreshed. [ 518.800586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 519.623962] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.624297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.624297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.624578] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.635213] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 519.637249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.637866] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 519.654470] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.654750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.654750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.655023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.655157] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.655299] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 519.655409] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.655510] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 519.675516] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.675732] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.675777] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.676056] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.676260] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.676410] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 519.697758] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.697970] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.698035] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.698287] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.698423] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.698561] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 519.718182] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.718412] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.718452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.718779] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.718874] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.718979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 519.719091] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.719188] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 519.737815] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.738048] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.738111] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.738365] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.738482] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.738620] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 519.738719] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.738820] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 519.759040] env[66919]: DEBUG networking_nsxv3.common.locking [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 519.759273] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 519.759321] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 519.759565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 519.759699] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.759864] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 519.759967] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 519.760072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Inventory metadata have been refreshed. [ 519.760170] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Dryrun:True. Metadata refresh completed. [ 519.760278] env[66919]: DEBUG oslo_concurrency.lockutils [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 519.761881] env[66919]: INFO neutron.agent.agent_extensions_manager [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Loaded agent extensions: [] [ 519.762565] env[66919]: DEBUG neutron_lib.callbacks.manager [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66919) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 519.824203] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent RPC Daemon Started! [ 519.824592] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:0 started [ 519.824592] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent out of sync with plugin! [ 524.763450] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 524.763845] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 529.765213] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 529.765602] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 534.492642] env[66919]: INFO networking_nsxv3.common.synchronization [None req-61c7e090-4ab7-4acd-b369-4130ca3d6988 demo admin] Enqueued Resource ID: 1fed56c9-035d-4e9d-a38f-4ade7d0df7cd with Priority: HIGHEST for action security_group_rules [ 534.494876] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fed56c9-035d-4e9d-a38f-4ade7d0df7cd with Priority: HIGHEST for action security_group_rules [ 534.495036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1fed56c9-035d-4e9d-a38f-4ade7d0df7cd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 534.495265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1fed56c9-035d-4e9d-a38f-4ade7d0df7cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 534.495350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1fed56c9-035d-4e9d-a38f-4ade7d0df7cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 534.495670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1fed56c9-035d-4e9d-a38f-4ade7d0df7cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 534.495753] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1fed56c9-035d-4e9d-a38f-4ade7d0df7cd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 535.021235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 535.021483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 535.021566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 535.021835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 535.021916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 535.022048] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1fed56c9-035d-4e9d-a38f-4ade7d0df7cd already deleted. [ 535.022146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1fed56c9-035d-4e9d-a38f-4ade7d0df7cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.496271] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 539.496727] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.766102] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.766582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.766582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.766582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.766774] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.269547] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 541.772281] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.274592] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 542.274790] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 542.990076] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.990480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.990480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.990480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.002165] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 543.002954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.003603] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 543.024147] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.024419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.024419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.024640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.024713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.024765] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 543.024841] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.024904] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 543.044504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.044776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.044776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.044913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.045227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.045227] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 543.064075] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.064269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.064269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.064495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.064606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.064713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 543.082858] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.083026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.083069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.083238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.083391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.083498] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 543.083566] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.083638] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 543.100859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.101057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.101057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.101251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.101358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.101456] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 543.101527] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.101599] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 543.122178] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.122349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.122390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.122557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.122658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.122768] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 543.122838] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 543.122902] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 543.122965] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 543.123051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 543.123113] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 543.123171] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 543.123495] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 543.123551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 543.123626] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 543.146917] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.147134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.147134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.147335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.147440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.147549] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 543.171134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 543.171341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 543.171341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 543.171545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 543.171649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 543.205228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 544.499052] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.499052] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.498522] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.498970] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 554.500042] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 554.500042] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 559.501096] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 559.501096] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 562.699087] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e25cbad3-1099-4ec1-8220-95129941c765 None None] Enqueued Resource ID: e454abbc-c1fb-4b60-9794-7ad523ec812d with Priority: HIGHEST for action port [ 562.699087] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e454abbc-c1fb-4b60-9794-7ad523ec812d with Priority: HIGHEST for action port [ 562.699087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e454abbc-c1fb-4b60-9794-7ad523ec812d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.699087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e454abbc-c1fb-4b60-9794-7ad523ec812d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.699087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e454abbc-c1fb-4b60-9794-7ad523ec812d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.699087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e454abbc-c1fb-4b60-9794-7ad523ec812d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.699087] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e454abbc-c1fb-4b60-9794-7ad523ec812d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.203549] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e454abbc-c1fb-4b60-9794-7ad523ec812d [ 563.203549] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.203549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.203549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.203549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.203549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.203881] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e454abbc-c1fb-4b60-9794-7ad523ec812d already deleted. [ 563.203881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e454abbc-c1fb-4b60-9794-7ad523ec812d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.169305] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3d5801cd-d773-472a-9974-811601bd630f None None] Enqueued Resource ID: a9d88974-c8bf-475f-80e5-8395f4352fef with Priority: HIGHEST for action port [ 564.169305] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9d88974-c8bf-475f-80e5-8395f4352fef with Priority: HIGHEST for action port [ 564.169732] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9d88974-c8bf-475f-80e5-8395f4352fef taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.169732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9d88974-c8bf-475f-80e5-8395f4352fef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.169732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9d88974-c8bf-475f-80e5-8395f4352fef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.169971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9d88974-c8bf-475f-80e5-8395f4352fef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.170234] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9d88974-c8bf-475f-80e5-8395f4352fef',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.628387] env[66919]: INFO networking_nsxv3.common.synchronization [None req-58e7d24b-e9b8-4042-98e8-54788620c064 None None] Enqueued Resource ID: f13fe464-4b7d-461e-8214-020c9e58bc2d with Priority: HIGHEST for action port [ 564.628387] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f13fe464-4b7d-461e-8214-020c9e58bc2d with Priority: HIGHEST for action port [ 564.628387] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f13fe464-4b7d-461e-8214-020c9e58bc2d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.628387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f13fe464-4b7d-461e-8214-020c9e58bc2d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.628387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f13fe464-4b7d-461e-8214-020c9e58bc2d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.628738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f13fe464-4b7d-461e-8214-020c9e58bc2d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.628738] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f13fe464-4b7d-461e-8214-020c9e58bc2d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.673920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9d88974-c8bf-475f-80e5-8395f4352fef [ 564.674166] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.674296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.674389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.674616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.674709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.674805] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9d88974-c8bf-475f-80e5-8395f4352fef already deleted. [ 564.674887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9d88974-c8bf-475f-80e5-8395f4352fef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.132541] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f13fe464-4b7d-461e-8214-020c9e58bc2d [ 565.132689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.132830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.132926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.133132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.133221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.133316] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f13fe464-4b7d-461e-8214-020c9e58bc2d already deleted. [ 565.133399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f13fe464-4b7d-461e-8214-020c9e58bc2d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.365066] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3944f88c-5ef2-498d-a01b-e0bc914c6a3b None None] Enqueued Resource ID: 64771c2f-3880-4ca8-a3de-ef481e7b3207 with Priority: HIGHEST for action port [ 566.365680] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64771c2f-3880-4ca8-a3de-ef481e7b3207 with Priority: HIGHEST for action port [ 566.365882] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-64771c2f-3880-4ca8-a3de-ef481e7b3207 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.366015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64771c2f-3880-4ca8-a3de-ef481e7b3207" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.366089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64771c2f-3880-4ca8-a3de-ef481e7b3207" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.366327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64771c2f-3880-4ca8-a3de-ef481e7b3207" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.366412] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64771c2f-3880-4ca8-a3de-ef481e7b3207',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.752581] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a9e8f91b-6375-4323-b124-ec673a2c871a None None] Enqueued Resource ID: 8326b65c-f82e-4009-ab0d-ac443fe94e28 with Priority: HIGHEST for action port [ 566.753754] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8326b65c-f82e-4009-ab0d-ac443fe94e28 with Priority: HIGHEST for action port [ 566.753754] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-8326b65c-f82e-4009-ab0d-ac443fe94e28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.753754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8326b65c-f82e-4009-ab0d-ac443fe94e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.753754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8326b65c-f82e-4009-ab0d-ac443fe94e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.753754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8326b65c-f82e-4009-ab0d-ac443fe94e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.753976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8326b65c-f82e-4009-ab0d-ac443fe94e28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.869852] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64771c2f-3880-4ca8-a3de-ef481e7b3207 [ 566.869852] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.869852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.869852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.870333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.870515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.871012] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64771c2f-3880-4ca8-a3de-ef481e7b3207 already deleted. [ 566.871012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64771c2f-3880-4ca8-a3de-ef481e7b3207" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.259267] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8326b65c-f82e-4009-ab0d-ac443fe94e28 [ 567.259579] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.259699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.259699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.259857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.259943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.260049] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8326b65c-f82e-4009-ab0d-ac443fe94e28 already deleted. [ 567.260134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8326b65c-f82e-4009-ab0d-ac443fe94e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.542822] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5d8d1c4d-9406-40eb-b72c-41f025eb4c34 None None] Enqueued Resource ID: ed7faea6-5407-429c-83b7-3ffec2e3fa3c with Priority: HIGHEST for action port [ 567.543322] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed7faea6-5407-429c-83b7-3ffec2e3fa3c with Priority: HIGHEST for action port [ 567.543610] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed7faea6-5407-429c-83b7-3ffec2e3fa3c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.543728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed7faea6-5407-429c-83b7-3ffec2e3fa3c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.543793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed7faea6-5407-429c-83b7-3ffec2e3fa3c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.548680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed7faea6-5407-429c-83b7-3ffec2e3fa3c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.548680] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed7faea6-5407-429c-83b7-3ffec2e3fa3c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.051397] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed7faea6-5407-429c-83b7-3ffec2e3fa3c [ 568.052566] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.052566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.052566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.052566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.052566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.052566] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed7faea6-5407-429c-83b7-3ffec2e3fa3c already deleted. [ 568.052566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed7faea6-5407-429c-83b7-3ffec2e3fa3c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.502877] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4cf89ec6-9c2f-4eef-ad69-61168eb46eda None None] Enqueued Resource ID: 573987cf-6a6a-4ed5-b456-35837f93dcb6 with Priority: HIGHEST for action port [ 568.503323] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 573987cf-6a6a-4ed5-b456-35837f93dcb6 with Priority: HIGHEST for action port [ 568.503625] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-573987cf-6a6a-4ed5-b456-35837f93dcb6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.503817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-573987cf-6a6a-4ed5-b456-35837f93dcb6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.503817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-573987cf-6a6a-4ed5-b456-35837f93dcb6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.504090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-573987cf-6a6a-4ed5-b456-35837f93dcb6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.504201] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('573987cf-6a6a-4ed5-b456-35837f93dcb6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.006655] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 573987cf-6a6a-4ed5-b456-35837f93dcb6 [ 569.006940] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.007055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.007127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.007336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.007427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.007519] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:573987cf-6a6a-4ed5-b456-35837f93dcb6 already deleted. [ 569.007601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-573987cf-6a6a-4ed5-b456-35837f93dcb6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.271628] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d1029d0c-6e8c-4772-b029-21cdedce8de5 None None] Enqueued Resource ID: 9727b104-8e85-4aa5-9fc6-1d45c36b727b with Priority: HIGHEST for action port [ 569.271628] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9727b104-8e85-4aa5-9fc6-1d45c36b727b with Priority: HIGHEST for action port [ 569.271628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9727b104-8e85-4aa5-9fc6-1d45c36b727b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.271628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9727b104-8e85-4aa5-9fc6-1d45c36b727b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.271628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9727b104-8e85-4aa5-9fc6-1d45c36b727b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.272157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9727b104-8e85-4aa5-9fc6-1d45c36b727b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.273306] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9727b104-8e85-4aa5-9fc6-1d45c36b727b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.482327] env[66919]: INFO networking_nsxv3.common.synchronization [None req-20577e3c-060b-449c-954d-70c1a68dc851 None None] Enqueued Resource ID: 352d6eda-775e-4eb0-bbb5-b99d2d591ff8 with Priority: HIGHEST for action port [ 569.482916] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 352d6eda-775e-4eb0-bbb5-b99d2d591ff8 with Priority: HIGHEST for action port [ 569.483197] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-352d6eda-775e-4eb0-bbb5-b99d2d591ff8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.483320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-352d6eda-775e-4eb0-bbb5-b99d2d591ff8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.483380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-352d6eda-775e-4eb0-bbb5-b99d2d591ff8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.484068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-352d6eda-775e-4eb0-bbb5-b99d2d591ff8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.484068] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('352d6eda-775e-4eb0-bbb5-b99d2d591ff8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.775183] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9727b104-8e85-4aa5-9fc6-1d45c36b727b [ 569.775684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.775831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.775900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.776120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.776217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.776303] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9727b104-8e85-4aa5-9fc6-1d45c36b727b already deleted. [ 569.776377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9727b104-8e85-4aa5-9fc6-1d45c36b727b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.915011] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f712ba1e-3e0b-41d1-b288-58150f210483 None None] Enqueued Resource ID: 5d21fd32-a706-4133-8680-1126ea85a222 with Priority: HIGHEST for action port [ 569.915545] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d21fd32-a706-4133-8680-1126ea85a222 with Priority: HIGHEST for action port [ 569.915836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d21fd32-a706-4133-8680-1126ea85a222 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.915973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d21fd32-a706-4133-8680-1126ea85a222" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.916038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d21fd32-a706-4133-8680-1126ea85a222" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.916294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d21fd32-a706-4133-8680-1126ea85a222" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.916377] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d21fd32-a706-4133-8680-1126ea85a222',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.985818] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 352d6eda-775e-4eb0-bbb5-b99d2d591ff8 [ 569.986044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.986180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.986251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.986590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.986645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.986746] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:352d6eda-775e-4eb0-bbb5-b99d2d591ff8 already deleted. [ 569.986880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-352d6eda-775e-4eb0-bbb5-b99d2d591ff8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.420238] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d21fd32-a706-4133-8680-1126ea85a222 [ 570.420504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.423017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.423017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.423017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.423017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.423017] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d21fd32-a706-4133-8680-1126ea85a222 already deleted. [ 570.423017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d21fd32-a706-4133-8680-1126ea85a222" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.302807] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fceda25b-c697-4bb7-84b1-a78a0bbbf378 None None] Enqueued Resource ID: 38413e89-ba10-4316-b644-9d3cc17f2807 with Priority: HIGHEST for action port [ 571.302807] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38413e89-ba10-4316-b644-9d3cc17f2807 with Priority: HIGHEST for action port [ 571.302807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-38413e89-ba10-4316-b644-9d3cc17f2807 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.302807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38413e89-ba10-4316-b644-9d3cc17f2807" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.302807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38413e89-ba10-4316-b644-9d3cc17f2807" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.302807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38413e89-ba10-4316-b644-9d3cc17f2807" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.302807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38413e89-ba10-4316-b644-9d3cc17f2807',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.803411] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 38413e89-ba10-4316-b644-9d3cc17f2807 [ 571.803680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.803773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.807036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.807036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.807036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.807036] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:38413e89-ba10-4316-b644-9d3cc17f2807 already deleted. [ 571.807036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38413e89-ba10-4316-b644-9d3cc17f2807" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.860745] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b45d8e69-c2d0-4574-a483-5e60eb94b887 None None] Enqueued Resource ID: 73b607a1-0a5c-47f8-a7d3-6302db6fc8dd with Priority: HIGHEST for action port [ 571.860745] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73b607a1-0a5c-47f8-a7d3-6302db6fc8dd with Priority: HIGHEST for action port [ 571.861266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-73b607a1-0a5c-47f8-a7d3-6302db6fc8dd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.861400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73b607a1-0a5c-47f8-a7d3-6302db6fc8dd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.861471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73b607a1-0a5c-47f8-a7d3-6302db6fc8dd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.861717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73b607a1-0a5c-47f8-a7d3-6302db6fc8dd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.861793] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73b607a1-0a5c-47f8-a7d3-6302db6fc8dd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.099562] env[66919]: INFO networking_nsxv3.common.synchronization [None req-7dc2e10c-695e-48e3-9eb1-2e567dce969d None None] Enqueued Resource ID: ad0a0023-b122-4ea2-be59-8ce005b9a5a0 with Priority: HIGHEST for action port [ 572.103020] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad0a0023-b122-4ea2-be59-8ce005b9a5a0 with Priority: HIGHEST for action port [ 572.103020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad0a0023-b122-4ea2-be59-8ce005b9a5a0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.103020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad0a0023-b122-4ea2-be59-8ce005b9a5a0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.103020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad0a0023-b122-4ea2-be59-8ce005b9a5a0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.103020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad0a0023-b122-4ea2-be59-8ce005b9a5a0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.103020] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0a0023-b122-4ea2-be59-8ce005b9a5a0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.365102] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73b607a1-0a5c-47f8-a7d3-6302db6fc8dd [ 572.365353] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.365493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.365562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.366145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.366145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.366145] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73b607a1-0a5c-47f8-a7d3-6302db6fc8dd already deleted. [ 572.366145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73b607a1-0a5c-47f8-a7d3-6302db6fc8dd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.603542] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad0a0023-b122-4ea2-be59-8ce005b9a5a0 [ 572.603770] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.603914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.603985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.604219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.604312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.604483] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad0a0023-b122-4ea2-be59-8ce005b9a5a0 already deleted. [ 572.604575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad0a0023-b122-4ea2-be59-8ce005b9a5a0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.633172] env[66919]: INFO networking_nsxv3.common.synchronization [None req-90edb5de-176b-4c56-b49c-0cb8719b143d None None] Enqueued Resource ID: 93913e71-7b8f-45c4-8989-9002e906c749 with Priority: HIGHEST for action port [ 572.633172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93913e71-7b8f-45c4-8989-9002e906c749 with Priority: HIGHEST for action port [ 572.633326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-93913e71-7b8f-45c4-8989-9002e906c749 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.633378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93913e71-7b8f-45c4-8989-9002e906c749" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.633412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93913e71-7b8f-45c4-8989-9002e906c749" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.633747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93913e71-7b8f-45c4-8989-9002e906c749" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.633747] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93913e71-7b8f-45c4-8989-9002e906c749',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.139232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93913e71-7b8f-45c4-8989-9002e906c749 [ 573.139232] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.139232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.139232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.139232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.139232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.139232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93913e71-7b8f-45c4-8989-9002e906c749 already deleted. [ 573.139232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93913e71-7b8f-45c4-8989-9002e906c749" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.512025] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ad78db03-89c9-4d2c-9742-5149a3ade4cc None None] Enqueued Resource ID: 31c829b4-de82-400b-bab9-114016778982 with Priority: HIGHEST for action port [ 573.512645] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31c829b4-de82-400b-bab9-114016778982 with Priority: HIGHEST for action port [ 573.513122] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-31c829b4-de82-400b-bab9-114016778982 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.514061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31c829b4-de82-400b-bab9-114016778982" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.514061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31c829b4-de82-400b-bab9-114016778982" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.514154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31c829b4-de82-400b-bab9-114016778982" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.514229] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31c829b4-de82-400b-bab9-114016778982',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.016732] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31c829b4-de82-400b-bab9-114016778982 [ 574.017113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.017212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.017280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.017488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.017949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.017949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31c829b4-de82-400b-bab9-114016778982 already deleted. [ 574.017949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31c829b4-de82-400b-bab9-114016778982" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.387295] env[66919]: INFO networking_nsxv3.common.synchronization [None req-20d22e13-711f-4388-90f3-640c2996721e None None] Enqueued Resource ID: ee4cd1e3-e11d-4421-a589-b4f920dba751 with Priority: HIGHEST for action port [ 574.388263] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee4cd1e3-e11d-4421-a589-b4f920dba751 with Priority: HIGHEST for action port [ 574.389229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee4cd1e3-e11d-4421-a589-b4f920dba751 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.389229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee4cd1e3-e11d-4421-a589-b4f920dba751" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.389229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee4cd1e3-e11d-4421-a589-b4f920dba751" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.389666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee4cd1e3-e11d-4421-a589-b4f920dba751" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.389666] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee4cd1e3-e11d-4421-a589-b4f920dba751',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.892142] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee4cd1e3-e11d-4421-a589-b4f920dba751 [ 574.892374] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.892501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.892568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.892879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.892993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.893160] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee4cd1e3-e11d-4421-a589-b4f920dba751 already deleted. [ 574.893160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee4cd1e3-e11d-4421-a589-b4f920dba751" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.814071] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c4bfaf21-b549-4b41-92f1-82603813cb2a None None] Enqueued Resource ID: 5e80abdc-575f-4c5c-949b-f4d8d42b3990 with Priority: HIGHEST for action port [ 576.814351] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e80abdc-575f-4c5c-949b-f4d8d42b3990 with Priority: HIGHEST for action port [ 576.814944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e80abdc-575f-4c5c-949b-f4d8d42b3990 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.815080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e80abdc-575f-4c5c-949b-f4d8d42b3990" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.815150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e80abdc-575f-4c5c-949b-f4d8d42b3990" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.815391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e80abdc-575f-4c5c-949b-f4d8d42b3990" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.815474] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e80abdc-575f-4c5c-949b-f4d8d42b3990',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.319268] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e80abdc-575f-4c5c-949b-f4d8d42b3990 [ 577.319362] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.319496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.319562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.319775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.319861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.319953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e80abdc-575f-4c5c-949b-f4d8d42b3990 already deleted. [ 577.320044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e80abdc-575f-4c5c-949b-f4d8d42b3990" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.556670] env[66919]: INFO networking_nsxv3.common.synchronization [None req-78c92c82-ffd4-4653-9f80-99e11780628d None None] Enqueued Resource ID: 51de402d-f106-4473-bbe4-7d415747fea7 with Priority: HIGHEST for action port [ 577.556928] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51de402d-f106-4473-bbe4-7d415747fea7 with Priority: HIGHEST for action port [ 577.557706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-51de402d-f106-4473-bbe4-7d415747fea7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.557706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51de402d-f106-4473-bbe4-7d415747fea7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.557706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51de402d-f106-4473-bbe4-7d415747fea7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.558982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51de402d-f106-4473-bbe4-7d415747fea7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.558982] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51de402d-f106-4473-bbe4-7d415747fea7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.658035] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a694c8f8-47c7-412d-9663-163045405668 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 577.658557] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 577.658855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.658980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.659082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.659401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.659480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.849147] env[66919]: INFO networking_nsxv3.common.synchronization [None req-093afebf-5850-4e1d-b63f-38f78497a91b None None] Enqueued Resource ID: fa47c03d-835a-4cef-bd1f-bf8f9be13b91 with Priority: HIGHEST for action port [ 577.849726] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa47c03d-835a-4cef-bd1f-bf8f9be13b91 with Priority: HIGHEST for action port [ 577.851293] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa47c03d-835a-4cef-bd1f-bf8f9be13b91 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.851460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa47c03d-835a-4cef-bd1f-bf8f9be13b91" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.851513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa47c03d-835a-4cef-bd1f-bf8f9be13b91" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.851750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa47c03d-835a-4cef-bd1f-bf8f9be13b91" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.851837] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa47c03d-835a-4cef-bd1f-bf8f9be13b91',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.865334] env[66919]: INFO networking_nsxv3.common.synchronization [None req-86a178a4-82f6-44f0-b1df-a13b69dbb0e2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 577.866050] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 577.867762] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.867762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.913609] env[66919]: INFO networking_nsxv3.common.synchronization [None req-18def2b5-5eec-4b8f-b095-c02bcd171138 None None] Enqueued Resource ID: b2e4f85e-049b-4fcf-8fa6-0bb331e4000c with Priority: HIGHEST for action port [ 577.913736] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2e4f85e-049b-4fcf-8fa6-0bb331e4000c with Priority: HIGHEST for action port [ 577.914817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2e4f85e-049b-4fcf-8fa6-0bb331e4000c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.919816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2e4f85e-049b-4fcf-8fa6-0bb331e4000c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.919964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2e4f85e-049b-4fcf-8fa6-0bb331e4000c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.920283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2e4f85e-049b-4fcf-8fa6-0bb331e4000c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.920392] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2e4f85e-049b-4fcf-8fa6-0bb331e4000c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.066041] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51de402d-f106-4473-bbe4-7d415747fea7 [ 578.066041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.066041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.066041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.066041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.066041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.066041] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51de402d-f106-4473-bbe4-7d415747fea7 already deleted. [ 578.066041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51de402d-f106-4473-bbe4-7d415747fea7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.188676] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.188844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.188892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.189135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.190351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.190351] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d already deleted. [ 578.190351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.190351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.190351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.190351] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.275290] env[66919]: INFO networking_nsxv3.common.synchronization [req-b4a3fa8b-c70f-4c48-b3e8-f5d8c6579db2 req-c81d5a0d-9c47-44e7-9b26-2befab0f9b4f tempest-ServerMetadataTestJSON-1609507993 tempest-ServerMetadataTestJSON-1609507993-project-member] Enqueued Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 578.275801] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 578.276138] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.276258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.276323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.276992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.277220] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.277329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.277392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.277615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.277698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.277789] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.354753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa47c03d-835a-4cef-bd1f-bf8f9be13b91 [ 578.354753] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.354753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.354753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.354753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.354753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.354753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa47c03d-835a-4cef-bd1f-bf8f9be13b91 already deleted. [ 578.354753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa47c03d-835a-4cef-bd1f-bf8f9be13b91" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.423554] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2e4f85e-049b-4fcf-8fa6-0bb331e4000c [ 578.423763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.423889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.423954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.424180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.424263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.424356] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2e4f85e-049b-4fcf-8fa6-0bb331e4000c already deleted. [ 578.424430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2e4f85e-049b-4fcf-8fa6-0bb331e4000c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.713866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.714519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.714923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.715282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.716774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.716899] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d already deleted. [ 578.716997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.779968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.781670] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.781670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd already deleted. [ 578.781670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.862649] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c27471c9-8b22-4b19-9f74-1d2d31b4d81b tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 578.862957] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 578.863137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.863259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.863362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.863573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.863651] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.360897] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.361188] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-668" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.361360] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-668" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.361605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-668" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.361877] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.363649] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.364388] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.364388] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.364388] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.365431] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 579.365431] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 579.365431] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 579.365431] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 579.365431] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 579.365431] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 579.365657] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 579.403377] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 579.403574] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 579.403729] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 579.404019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-668" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.404246] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-954185c2-3510-4ab0-b8a9-f704761e8cb9 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.405042] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.405042] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.405042] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.409128] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954185c2-3510-4ab0-b8a9-f704761e8cb9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.410932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.411082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.411154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.411404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.411466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.411520] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 already deleted. [ 579.411628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.547766] env[66919]: INFO networking_nsxv3.common.synchronization [None req-cd658e8f-e711-47b1-88a5-3bd70a8293e9 None None] Enqueued Resource ID: 3f051fb2-7f85-4f6d-93d7-e01d5d41682f with Priority: HIGHEST for action port [ 579.548045] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f051fb2-7f85-4f6d-93d7-e01d5d41682f with Priority: HIGHEST for action port [ 579.548607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f051fb2-7f85-4f6d-93d7-e01d5d41682f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.548733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f051fb2-7f85-4f6d-93d7-e01d5d41682f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.548802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f051fb2-7f85-4f6d-93d7-e01d5d41682f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.549082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f051fb2-7f85-4f6d-93d7-e01d5d41682f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.549171] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f051fb2-7f85-4f6d-93d7-e01d5d41682f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.778868] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d54b4c6e-67c5-4e7e-a73c-3b114ad4f3cd tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 579.778868] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 579.778868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.778868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.778868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.779428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.779638] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.915036] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.915036] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 954185c2-3510-4ab0-b8a9-f704761e8cb9 not found, creating... [ 579.915036] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.915036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.916263] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.916263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.916263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.916263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.916263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.916263] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 954185c2-3510-4ab0-b8a9-f704761e8cb9 is going to be created. [ 579.954137] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.954357] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.954478] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.954751] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.955026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.955812] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.051720] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f051fb2-7f85-4f6d-93d7-e01d5d41682f [ 580.051908] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.051908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.052021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.052658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.052658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.052658] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f051fb2-7f85-4f6d-93d7-e01d5d41682f already deleted. [ 580.052658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f051fb2-7f85-4f6d-93d7-e01d5d41682f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.300637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.300791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.300861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.303862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.303862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.303862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 already deleted. [ 580.303862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.718305] env[66919]: INFO networking_nsxv3.common.synchronization [req-b4a3fa8b-c70f-4c48-b3e8-f5d8c6579db2 req-9fd8cb6d-ab1b-485c-aa3b-22c12776d449 service nova] Enqueued Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_rules [ 580.718478] env[66919]: INFO networking_nsxv3.common.synchronization [req-b4a3fa8b-c70f-4c48-b3e8-f5d8c6579db2 req-9fd8cb6d-ab1b-485c-aa3b-22c12776d449 service nova] Enqueued Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 580.718622] env[66919]: INFO networking_nsxv3.common.synchronization [req-b4a3fa8b-c70f-4c48-b3e8-f5d8c6579db2 req-9fd8cb6d-ab1b-485c-aa3b-22c12776d449 service nova] Enqueued Resource ID: 954185c2-3510-4ab0-b8a9-f704761e8cb9 with Priority: HIGHEST for action port [ 580.718853] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_rules [ 580.718992] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 580.719100] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 954185c2-3510-4ab0-b8a9-f704761e8cb9 with Priority: HIGHEST for action port [ 580.719644] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.719772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.719843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.720485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.720580] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.723029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.723147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.723215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.723400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.723590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.723691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.723782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.723903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.723987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.724094] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.725519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-954185c2-3510-4ab0-b8a9-f704761e8cb9 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.725620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.725681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.726058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.726058] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('954185c2-3510-4ab0-b8a9-f704761e8cb9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.822165] env[66919]: INFO networking_nsxv3.common.synchronization [req-bba316a9-f180-4fe5-9f24-1a773a45abaa req-a563a12c-eddc-4a2b-83db-9260a5201ad7 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 580.822165] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 580.822165] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.822165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.822165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.822962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.823281] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.823532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.823709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.824009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.824311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.825874] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.228202] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.228202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.239155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 954185c2-3510-4ab0-b8a9-f704761e8cb9 with status ACTIVE [ 581.239443] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.239662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.239751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.239926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.240030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.240262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.240463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.240521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.240677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.240734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.240908] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.241057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.241103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.241252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.241317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.241406] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 954185c2-3510-4ab0-b8a9-f704761e8cb9 is going to be updated. [ 581.242541] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.247874] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.248062] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.248243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.248483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.248731] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.248878] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.248986] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.249206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.249443] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.249908] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.250037] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 581.250148] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 581.250253] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 581.250361] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 581.250462] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 581.250592] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 581.265339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.265588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.265588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.265751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.265930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.266120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-954185c2-3510-4ab0-b8a9-f704761e8cb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.269803] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 581.269803] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 581.269803] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 581.269967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.270179] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-e8b7f812-2d7c-411d-8ebd-0019d9685d18 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.270343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.270453] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.270739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.270873] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b7f812-2d7c-411d-8ebd-0019d9685d18',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.327515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.327694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.327765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.327948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.328200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.328267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.328362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.328428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.328568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.328641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.328719] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 already deleted. [ 581.328792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.744996] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.773363] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.774034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.774034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.774034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.774198] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.774232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port e8b7f812-2d7c-411d-8ebd-0019d9685d18 not found, creating... [ 581.774482] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.775068] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.775068] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.775068] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.775312] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.775439] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.775588] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.775699] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.775897] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.777433] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.777641] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: e8b7f812-2d7c-411d-8ebd-0019d9685d18 is going to be created. [ 581.800760] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.800972] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.801100] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.801374] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.801618] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.801794] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.168233] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3a724fcc-dd5b-4c08-96e0-49155cde4d59 None None] Enqueued Resource ID: ebdf6590-3690-4033-91fa-ec524e18bcfb with Priority: HIGHEST for action port [ 582.168233] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ebdf6590-3690-4033-91fa-ec524e18bcfb with Priority: HIGHEST for action port [ 582.168233] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ebdf6590-3690-4033-91fa-ec524e18bcfb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.168233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ebdf6590-3690-4033-91fa-ec524e18bcfb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.168233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ebdf6590-3690-4033-91fa-ec524e18bcfb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.168233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ebdf6590-3690-4033-91fa-ec524e18bcfb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.168661] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ebdf6590-3690-4033-91fa-ec524e18bcfb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.250370] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.250656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.250656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.250817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.250904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.251010] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd is going to be created. [ 582.340551] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.340551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.340551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.340551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.340551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.352576] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: UNINITIALIZED for 2s [ 582.500291] env[66919]: INFO networking_nsxv3.common.synchronization [req-bba316a9-f180-4fe5-9f24-1a773a45abaa req-0df09f11-baf6-4368-851b-52e86a78ca89 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 582.501918] env[66919]: INFO networking_nsxv3.common.synchronization [req-bba316a9-f180-4fe5-9f24-1a773a45abaa req-0df09f11-baf6-4368-851b-52e86a78ca89 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 582.501918] env[66919]: INFO networking_nsxv3.common.synchronization [req-bba316a9-f180-4fe5-9f24-1a773a45abaa req-0df09f11-baf6-4368-851b-52e86a78ca89 service nova] Enqueued Resource ID: e8b7f812-2d7c-411d-8ebd-0019d9685d18 with Priority: HIGHEST for action port [ 582.501918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 582.501918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 582.501918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8b7f812-2d7c-411d-8ebd-0019d9685d18 with Priority: HIGHEST for action port [ 582.502276] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.502276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.502276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.502394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.502464] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.503282] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.503402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.503470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.503635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.503777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.503864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.503923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.504075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.504172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.504259] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.505010] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8b7f812-2d7c-411d-8ebd-0019d9685d18 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.505323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.505398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.505552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.505625] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8b7f812-2d7c-411d-8ebd-0019d9685d18',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.671799] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ebdf6590-3690-4033-91fa-ec524e18bcfb [ 582.672044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.673298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.673298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.673298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.673298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.673298] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ebdf6590-3690-4033-91fa-ec524e18bcfb already deleted. [ 582.673298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ebdf6590-3690-4033-91fa-ec524e18bcfb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.005980] env[66919]: INFO networking_nsxv3.common.synchronization [req-02766af1-552a-4534-89bd-59b6afd1faeb req-50fa4c96-90e3-478b-b2a9-e82c2c2c7c08 tempest-ServerDiagnosticsTest-108375797 tempest-ServerDiagnosticsTest-108375797-project-member] Enqueued Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 583.005980] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 583.005980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.005980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.005980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.005980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.007137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.007304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.007369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.007554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.007643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.007754] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.008889] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.008983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.009629] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.009979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e8b7f812-2d7c-411d-8ebd-0019d9685d18 with status ACTIVE [ 583.010192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.010783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.010783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.010783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.010783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.010783] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.010983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.010983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.013144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.013270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.013439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.013813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.013916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.014247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.014247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.014247] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e8b7f812-2d7c-411d-8ebd-0019d9685d18 is going to be updated. [ 583.038587] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.039092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.039092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.039092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.039251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.039395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8b7f812-2d7c-411d-8ebd-0019d9685d18" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.434643] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.434954] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.434954] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.435352] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.435618] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.436731] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.436731] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.439310] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.439543] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.439772] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.439904] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.440035] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.440165] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.440314] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.440448] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.440605] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.466578] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.466752] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.466883] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.467084] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.467430] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-5db8df83-5204-430c-81e8-593d9bca4477 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.467608] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.467727] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.468058] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.468196] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db8df83-5204-430c-81e8-593d9bca4477',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.512873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.512873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.512873] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 already deleted. [ 583.512873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.516695] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.617579] env[66919]: INFO networking_nsxv3.common.synchronization [None req-78e9dcc6-54f8-406a-a28e-60085dc98fee None None] Enqueued Resource ID: b9cd8579-3186-4b1f-a206-edd66792b479 with Priority: HIGHEST for action port [ 583.618201] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9cd8579-3186-4b1f-a206-edd66792b479 with Priority: HIGHEST for action port [ 583.618923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9cd8579-3186-4b1f-a206-edd66792b479 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.618923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9cd8579-3186-4b1f-a206-edd66792b479" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.618923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9cd8579-3186-4b1f-a206-edd66792b479" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.620211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9cd8579-3186-4b1f-a206-edd66792b479" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.620342] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9cd8579-3186-4b1f-a206-edd66792b479',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.860516] env[66919]: INFO networking_nsxv3.common.synchronization [None req-8bf82d86-1f0e-4d95-9001-8f4f5114f60a tempest-VolumesAssistedSnapshotsTest-235246620 tempest-VolumesAssistedSnapshotsTest-235246620-project-member] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 583.862103] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 583.862103] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.862103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.862103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.864277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.864277] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.960559] env[66919]: INFO networking_nsxv3.common.synchronization [None req-bba9dbac-75eb-47a6-a47f-407c961f69fd None None] Enqueued Resource ID: e04220c1-6eac-4489-ab9b-6bb0246f94f1 with Priority: HIGHEST for action port [ 583.961238] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e04220c1-6eac-4489-ab9b-6bb0246f94f1 with Priority: HIGHEST for action port [ 583.961378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e04220c1-6eac-4489-ab9b-6bb0246f94f1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.961555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e04220c1-6eac-4489-ab9b-6bb0246f94f1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.961555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e04220c1-6eac-4489-ab9b-6bb0246f94f1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.962256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e04220c1-6eac-4489-ab9b-6bb0246f94f1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.962256] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e04220c1-6eac-4489-ab9b-6bb0246f94f1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.971956] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.972192] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.972309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.972576] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.972724] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.973167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 5db8df83-5204-430c-81e8-593d9bca4477 not found, creating... [ 583.973167] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.973319] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.973402] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.973609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.973728] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.973987] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.974139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.974473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.974473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.974568] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.974677] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 5db8df83-5204-430c-81e8-593d9bca4477 is going to be created. [ 583.995825] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.996390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.996390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.996534] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.996715] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.996924] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.019241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.019345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.019411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.019618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.019708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.019830] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be created. [ 584.046442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.046590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.046668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.046890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.047074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.067088] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: UNINITIALIZED for 2s [ 584.124339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9cd8579-3186-4b1f-a206-edd66792b479 [ 584.124339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.124339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.124339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.124339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.124339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.124339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9cd8579-3186-4b1f-a206-edd66792b479 already deleted. [ 584.124339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9cd8579-3186-4b1f-a206-edd66792b479" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.364699] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: SUCCESS [ 584.364947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.366048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.366270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.366459] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.366573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.366635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.366788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.366871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.366952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.367054] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.382736] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.382736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.382736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.382736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.382736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.382736] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b already deleted. [ 584.382981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.466111] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e04220c1-6eac-4489-ab9b-6bb0246f94f1 [ 584.466565] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.467868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.468242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.468242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.468360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.468417] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e04220c1-6eac-4489-ab9b-6bb0246f94f1 already deleted. [ 584.468491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e04220c1-6eac-4489-ab9b-6bb0246f94f1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.546913] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4e491b9b-c6c5-4dba-91ab-086eb89474bb tempest-VolumesAssistedSnapshotsTest-235246620 tempest-VolumesAssistedSnapshotsTest-235246620-project-member] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 584.547524] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 584.548481] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.548635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.548698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.548907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.548976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.770910] env[66919]: INFO networking_nsxv3.common.synchronization [req-02766af1-552a-4534-89bd-59b6afd1faeb req-8afec1e3-d8a7-473d-90af-77aad2b7701e service nova] Enqueued Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_rules [ 584.771088] env[66919]: INFO networking_nsxv3.common.synchronization [req-02766af1-552a-4534-89bd-59b6afd1faeb req-8afec1e3-d8a7-473d-90af-77aad2b7701e service nova] Enqueued Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 584.771228] env[66919]: INFO networking_nsxv3.common.synchronization [req-02766af1-552a-4534-89bd-59b6afd1faeb req-8afec1e3-d8a7-473d-90af-77aad2b7701e service nova] Enqueued Resource ID: 5db8df83-5204-430c-81e8-593d9bca4477 with Priority: HIGHEST for action port [ 584.771429] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_rules [ 584.771545] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 584.771636] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5db8df83-5204-430c-81e8-593d9bca4477 with Priority: HIGHEST for action port [ 584.772182] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.772300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.772365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.772603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.772679] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.773887] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.773998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.774077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.774265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.774347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.774437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.774495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.774631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.776103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.776103] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.776103] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5db8df83-5204-430c-81e8-593d9bca4477 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.776103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.776103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.776103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.776103] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5db8df83-5204-430c-81e8-593d9bca4477',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.872631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.872631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.872631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.872631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.872631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.873332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.873332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.873332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.873332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.873332] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.071799] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.072047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.072181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.072471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.072612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.072741] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b already deleted. [ 585.072840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.277145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.277290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.277514] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.278384] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5db8df83-5204-430c-81e8-593d9bca4477 with status ACTIVE [ 585.279400] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.279400] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.279400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.279838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.279838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.279838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.279838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.279838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.280069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.280069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.280155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5db8df83-5204-430c-81e8-593d9bca4477 is going to be updated. [ 585.303023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.303203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.303203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.303570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.303570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.303793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5db8df83-5204-430c-81e8-593d9bca4477" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.321339] env[66919]: INFO networking_nsxv3.common.synchronization [req-2a95fe80-31f9-4a79-8733-ef5a8922f49d req-542a43b9-6c8d-437c-a1ab-acda38e6ba09 tempest-ServerDiagnosticsNegativeTest-2142655531 tempest-ServerDiagnosticsNegativeTest-2142655531-project-member] Enqueued Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 585.321401] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 585.321658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.321777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.321847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.322106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.322258] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.322360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.322433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.322582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.322669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.322759] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.375823] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af39d9f2-2893-4829-94fc-ff7334ea19fd: rpc.has_security_group_logging(os_id): False [ 585.398418] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.398583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.398583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.398930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.398995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.399245] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.399356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.399418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.399583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.399659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.399828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.400163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.400285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.400471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.400638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.401805] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.401970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.402087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.402281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.402417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.402532] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd is going to be created. [ 585.508846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.509148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.509148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.509965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.509965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.523868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: IN_PROGRESS for 2s [ 585.722566] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.722869] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.722869] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.723191] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.723414] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.723569] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.723873] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.723940] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.724087] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.724294] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.724491] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.724720] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.724791] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.725255] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.725255] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.725255] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.744444] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.744719] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.744719] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.744885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.745306] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.745477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.745656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.745987] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.746105] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.782067] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.825302] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.825428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.825501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.825718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.825805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.826011] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.826114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.826250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.826420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.826469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.826554] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e already deleted. [ 585.826635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.081886] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 586.082104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.082262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.082532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.082700] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.082836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.082897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.083104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.083199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.083284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.083371] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.248554] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.248770] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.248890] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.249193] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.249340] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.249488] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a not found, creating... [ 586.249736] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.249885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.249997] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.250227] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.250357] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.250625] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.250772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.250880] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.251089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.251772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.251772] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a is going to be created. [ 586.278533] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.278765] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.278885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.279199] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.279426] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.279643] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.285165] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.287367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.287367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.288412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.288412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.288412] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 is going to be created. [ 586.315686] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.315907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.315907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.316686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.316686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.329749] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: UNINITIALIZED for 2s [ 586.586319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.586637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.586637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.586792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.586957] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.587072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.587136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.587286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.587399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.587477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.587646] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.587737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.587798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.587996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.588086] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.588930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.588930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.588930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.588930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.588930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.588930] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.998216] env[66919]: INFO networking_nsxv3.common.synchronization [req-2a95fe80-31f9-4a79-8733-ef5a8922f49d req-ed6cfa53-2e47-4e9b-9137-fbc733de792c service nova] Enqueued Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_rules [ 586.998216] env[66919]: INFO networking_nsxv3.common.synchronization [req-2a95fe80-31f9-4a79-8733-ef5a8922f49d req-ed6cfa53-2e47-4e9b-9137-fbc733de792c service nova] Enqueued Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 586.998216] env[66919]: INFO networking_nsxv3.common.synchronization [req-2a95fe80-31f9-4a79-8733-ef5a8922f49d req-ed6cfa53-2e47-4e9b-9137-fbc733de792c service nova] Enqueued Resource ID: 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a with Priority: HIGHEST for action port [ 586.998216] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_rules [ 586.998549] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 586.998549] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a with Priority: HIGHEST for action port [ 586.998930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.999614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.999614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.000213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.000213] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.001123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.001528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.001589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.002509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.002509] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.002509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.002509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.002509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.002509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.002509] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.006629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.006629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.006629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.006629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.006629] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.090393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5: rpc.has_security_group_logging(os_id): False [ 587.110950] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.111060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.111161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.111408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.111408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.113309] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.113309] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.113309] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.113309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.113810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.116038] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be created. [ 587.197508] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.197712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.197767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.197993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.198191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.211613] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 587.466928] env[66919]: INFO networking_nsxv3.common.synchronization [req-94fe3e89-a44a-4119-b70f-edabe6ecd0c1 req-337a59a9-521f-42bb-a4c4-ac84c5ecaff1 tempest-FloatingIPsAssociationTestJSON-1688354250 tempest-FloatingIPsAssociationTestJSON-1688354250-project-member] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 587.467364] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 587.468501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.468501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.468501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.468501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.468501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.468501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.468814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.468977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.469088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.469198] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.508885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.508885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.509157] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.511945] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a with status ACTIVE [ 587.511945] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.511945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.511945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.512172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.512211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.512902] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.512902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.512902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.512902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.512902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.513277] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.513277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.513277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.513398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.513490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.513526] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a is going to be updated. [ 587.547749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.548022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.548022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.548163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.548237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.548670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bbb6702-4a2b-4fd0-8ee1-ca3f9a5be26a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.549570] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: SUCCESS [ 587.549883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.884020] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.884323] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.884375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.884660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.884919] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.885084] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.885221] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.885441] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.885581] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.885780] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.885885] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.885985] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.886126] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.886269] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.886380] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.886507] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.906986] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.907304] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.907304] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.907460] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.907770] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.907936] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.908061] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.908459] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.908615] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf62919-2fcb-43f1-82ea-cadfc8f9b499',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.971443] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.972717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.972829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.973087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.973148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.973359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.973464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.973525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.973680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.973753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.973837] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 already deleted. [ 587.973914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.010908] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.248028] env[66919]: INFO networking_nsxv3.common.synchronization [None req-cf6d052f-cc8f-44d8-9ec2-4415f4eb4919 None None] Enqueued Resource ID: ce90316b-0d08-460a-a0d6-9fcd30b17c41 with Priority: HIGHEST for action port [ 588.248414] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce90316b-0d08-460a-a0d6-9fcd30b17c41 with Priority: HIGHEST for action port [ 588.248584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce90316b-0d08-460a-a0d6-9fcd30b17c41 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.248703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce90316b-0d08-460a-a0d6-9fcd30b17c41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.248765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce90316b-0d08-460a-a0d6-9fcd30b17c41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.249152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce90316b-0d08-460a-a0d6-9fcd30b17c41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.249236] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce90316b-0d08-460a-a0d6-9fcd30b17c41',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.340980] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: SUCCESS [ 588.341210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.341377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.341599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.341794] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.341914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.341980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.342169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.342253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.342343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.342433] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.415630] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.415823] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.415920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.416204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.416371] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.416552] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port dbf62919-2fcb-43f1-82ea-cadfc8f9b499 not found, creating... [ 588.416781] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.416935] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.417055] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.417297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.417431] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.417695] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.417840] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.417948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.418164] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.418323] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.418464] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: dbf62919-2fcb-43f1-82ea-cadfc8f9b499 is going to be created. [ 588.441735] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.441735] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.441735] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.442158] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.442158] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.442350] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.512929] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.513208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.513208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.513432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.513587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.513731] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e is going to be created. [ 588.551927] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.552159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.552159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.552392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.552552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.561420] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: UNINITIALIZED for 2s [ 588.752068] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce90316b-0d08-460a-a0d6-9fcd30b17c41 [ 588.752301] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.752437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.752571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.752713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.752802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.752969] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce90316b-0d08-460a-a0d6-9fcd30b17c41 already deleted. [ 588.753076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce90316b-0d08-460a-a0d6-9fcd30b17c41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.845651] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.846071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.846281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.846408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.846706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.846888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.846888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.847045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.847131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.847219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.847370] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.847461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.847528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.847658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.847793] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.847884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.847937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.848105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.848183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.848265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.848355] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.173795] env[66919]: INFO networking_nsxv3.common.synchronization [req-94fe3e89-a44a-4119-b70f-edabe6ecd0c1 req-e70b7856-5701-4101-b204-eeb9b7baf00c service nova] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_rules [ 589.173795] env[66919]: INFO networking_nsxv3.common.synchronization [req-94fe3e89-a44a-4119-b70f-edabe6ecd0c1 req-e70b7856-5701-4101-b204-eeb9b7baf00c service nova] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 589.174283] env[66919]: INFO networking_nsxv3.common.synchronization [req-94fe3e89-a44a-4119-b70f-edabe6ecd0c1 req-e70b7856-5701-4101-b204-eeb9b7baf00c service nova] Enqueued Resource ID: dbf62919-2fcb-43f1-82ea-cadfc8f9b499 with Priority: HIGHEST for action port [ 589.174412] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_rules [ 589.174537] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 589.174630] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf62919-2fcb-43f1-82ea-cadfc8f9b499 with Priority: HIGHEST for action port [ 589.174888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.175014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.175081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.175398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.175482] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.176516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.176610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.176675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.176849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.176990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.177110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.177172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.177308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.177391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.177478] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.180025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.180146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.180281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.180348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.180494] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf62919-2fcb-43f1-82ea-cadfc8f9b499',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.232428] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 589.232428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.350341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4689714c-abe3-425f-b780-ee3049d244c0: rpc.has_security_group_logging(os_id): False [ 589.369828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.369986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.370051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.370269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.370352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.370571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.370667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.370728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.370877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.370987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.371137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.371272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.371368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.371515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.371608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.372314] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.372314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.372314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.372314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.372314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.372314] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 is going to be created. [ 589.446624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.446818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.446862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.447083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.447267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.461228] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: IN_PROGRESS for 2s [ 589.640788] env[66919]: INFO networking_nsxv3.common.synchronization [req-0a62f382-cb4b-491c-875d-dcba6cdff86b req-c090a229-5afb-436c-b9e5-52a5cd55135f tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 589.641278] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 589.641578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.641700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.641768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.642170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.642458] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.642627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.642714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.642909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.643718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.643718] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.682297] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.683299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.683403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.683765] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbf62919-2fcb-43f1-82ea-cadfc8f9b499 with status ACTIVE [ 589.683938] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.684058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.684123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.684318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.684411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.684561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.684645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.684730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.684842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.684923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.687344] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.687344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.687344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.687344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.687344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.687344] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbf62919-2fcb-43f1-82ea-cadfc8f9b499 is going to be updated. [ 589.699846] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f806224-c849-4847-9555-4afb13b74d50 req-5261facc-fb63-47d9-85f4-3f2b332309b1 tempest-SecurityGroupRulesNegativeTestJSON-1462153794 tempest-SecurityGroupRulesNegativeTestJSON-1462153794-project-member] Enqueued Resource ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 with Priority: HIGHEST for action security_group_rules [ 589.700016] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 with Priority: HIGHEST for action security_group_rules [ 589.701128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.701128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.701128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.701252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.701281] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b0d8ac-1582-4ba9-bc4f-5122319cc528',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.708815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.709374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.709516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.709767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.710223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.710428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf62919-2fcb-43f1-82ea-cadfc8f9b499" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.002797] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.002797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.002976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.003264] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.003521] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.003673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.003784] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.004165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.004275] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.004585] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.005099] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.005349] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.005508] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.005744] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.005887] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.006058] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.029434] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ee1a84b0-6960-4a89-b6ed-70a6d51d242c None None] Enqueued Resource ID: 2e294a71-e594-4907-b27a-bd689142f52d with Priority: HIGHEST for action port [ 590.033183] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.033183] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.033183] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.033183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.033183] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.033183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.033183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.033183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.033183] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.036576] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e294a71-e594-4907-b27a-bd689142f52d with Priority: HIGHEST for action port [ 590.036576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e294a71-e594-4907-b27a-bd689142f52d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.036576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e294a71-e594-4907-b27a-bd689142f52d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.036576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e294a71-e594-4907-b27a-bd689142f52d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.036576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e294a71-e594-4907-b27a-bd689142f52d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.036576] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e294a71-e594-4907-b27a-bd689142f52d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.145958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.147718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.147718] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 already deleted. [ 590.147718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.185072] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.224934] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.226321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.226321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.226321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.226321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.226321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 already deleted. [ 590.226321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.539522] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.540089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.540089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.540213] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.540376] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.540537] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 not found, creating... [ 590.540860] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.541057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.541565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.541565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.541565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.541947] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.542073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.542148] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.542519] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.542674] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.542819] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 is going to be created. [ 590.544106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e294a71-e594-4907-b27a-bd689142f52d [ 590.546740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.546740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.546740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.546740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.546740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.546740] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e294a71-e594-4907-b27a-bd689142f52d already deleted. [ 590.546740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e294a71-e594-4907-b27a-bd689142f52d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.572386] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.572386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.572386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.572386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.572386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.572386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.574718] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: SUCCESS [ 590.575534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.576157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.576886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.577266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.578345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.578345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.578345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.578345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.578345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.578345] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.687890] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.688127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.688127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.688838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.689082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.689314] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be created. [ 590.727684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.727684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.727684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.727684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.727684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.740859] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: UNINITIALIZED for 2s [ 591.082426] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.082631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.083611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.083890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.084188] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.084292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.084394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.084654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.084782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.084883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.085121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.085248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.085333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.086016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.086016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.086016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.086016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.086016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.086016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.086286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.086286] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [req-0a62f382-cb4b-491c-875d-dcba6cdff86b req-107043dd-9d46-428c-bf01-1c063e5cfc7d service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [req-0a62f382-cb4b-491c-875d-dcba6cdff86b req-107043dd-9d46-428c-bf01-1c063e5cfc7d service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [req-0a62f382-cb4b-491c-875d-dcba6cdff86b req-107043dd-9d46-428c-bf01-1c063e5cfc7d service nova] Enqueued Resource ID: f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 with Priority: HIGHEST for action port [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 591.350475] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 with Priority: HIGHEST for action port [ 591.353812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.353812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.353812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.353812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.354251] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.355149] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.355149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.355439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.356446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.356446] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.356446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.356446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.356446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.356446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.356446] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.357290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.357392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.357483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.357625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.357691] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.474530] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: SUCCESS [ 591.474530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.590408] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34fb8f28-1898-4b72-aa0e-58d3cd80323e: rpc.has_security_group_logging(os_id): False [ 591.607890] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.608429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.608429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.608694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.608867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.609127] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.609234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.609318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.609496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.609573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.609762] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.609905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.609974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.610166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.610244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.610623] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.610803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.610928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.611202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.611354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.611523] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e is going to be created. [ 591.681560] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.681699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.681758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.681973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.682168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.696164] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: IN_PROGRESS for 2s [ 591.860370] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.861532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.861652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.861811] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 with status ACTIVE [ 591.861966] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.862164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.862164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.862373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.862463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.862589] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.862685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.862745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.862891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.862974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.864044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.864044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.864044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.864044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.864044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.864044] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0 is going to be updated. [ 591.886112] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.886450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.886450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.886604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.886781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.886885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f708fbb4-3a93-4c75-a71b-3fdbae8ee4d0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.366274] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.753167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 592.753167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.753167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.753504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.753504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.754703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.754703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.754703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.754703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.754703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.754703] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.868928] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.869216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.869216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.869419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.869661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.869661] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be created. [ 592.895918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.897039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.897177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.897456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.897557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.910217] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: UNINITIALIZED for 2s [ 593.112227] env[66919]: INFO networking_nsxv3.common.synchronization [req-d96e39c3-6b6a-421c-8426-b275dcad6734 req-c6b3f4af-a2bd-42cc-9ca3-0bff86479dad tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: bbb6ed99-9932-4120-bca7-c413763d0a75 with Priority: HIGHEST for action security_group_rules [ 593.112227] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbb6ed99-9932-4120-bca7-c413763d0a75 with Priority: HIGHEST for action security_group_rules [ 593.112548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbb6ed99-9932-4120-bca7-c413763d0a75 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.112605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbb6ed99-9932-4120-bca7-c413763d0a75" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.112678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbb6ed99-9932-4120-bca7-c413763d0a75" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.112953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbb6ed99-9932-4120-bca7-c413763d0a75" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.113052] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbb6ed99-9932-4120-bca7-c413763d0a75',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.257744] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.258142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.258142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.258373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.258572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.258681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.258807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.258932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.259037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.259243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.259289] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.259381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.259415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.259559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.259726] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.259841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.259841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.260045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.260127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.260165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.260271] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.512127] env[66919]: INFO networking_nsxv3.common.synchronization [req-d75f47dc-b272-46a8-a047-9053fd5f481b req-2e950625-f598-42cf-a020-90f10f9a4db6 tempest-SecurityGroupRulesNegativeTestJSON-1462153794 tempest-SecurityGroupRulesNegativeTestJSON-1462153794-project-member] Enqueued Resource ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 with Priority: HIGHEST for action security_group_rules [ 593.512127] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 with Priority: HIGHEST for action security_group_rules [ 593.512127] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.512127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.512127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.512127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.512127] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6b0d8ac-1582-4ba9-bc4f-5122319cc528',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.635091] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.635091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.635091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.635651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.635651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.635651] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbb6ed99-9932-4120-bca7-c413763d0a75 already deleted. [ 593.635651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbb6ed99-9932-4120-bca7-c413763d0a75" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.710302] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: SUCCESS [ 593.710600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.763036] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a88ee71-4c82-4813-b129-b022cced6be1: rpc.has_security_group_logging(os_id): False [ 593.782421] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.782635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.782635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.782853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.782935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.783160] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.783231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.783355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.783549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.783630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.783810] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.783902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.783952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.784105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.784179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.784371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.784456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.784508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.784639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.784741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.784786] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be created. [ 593.853513] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.853720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.853767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.853945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.854149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.869408] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 594.044603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.044830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.044950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.045307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.045307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.045307] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6b0d8ac-1582-4ba9-bc4f-5122319cc528 already deleted. [ 594.045629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6b0d8ac-1582-4ba9-bc4f-5122319cc528" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.921441] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 594.921820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.922142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.922255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.922372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.922499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.922560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.922715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.923121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.923121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.923121] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.426379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.426592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.426696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.427137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.427459] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.427571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.427571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.429392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.429532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.429614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.429797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.430166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.430239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.430431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.430592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.430697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.430765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.430909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.431074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.431125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.431173] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.885770] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 595.886210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.933150] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008: rpc.has_security_group_logging(os_id): False [ 595.953534] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.953747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.953826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.953980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.954140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.954369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.954497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.954558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.955372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.955372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.955372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.955372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.955372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.955680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.955680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.955959] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.956219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.956301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.956607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.956607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.956729] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be created. [ 596.018820] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.018974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.019065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.019283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.019470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.035124] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 597.316462] env[66919]: INFO networking_nsxv3.common.synchronization [None req-54120614-f596-4afb-a3dc-a8fec11e3ebd None None] Enqueued Resource ID: 203b9bd0-a2b7-42e7-99a5-144533334f8a with Priority: HIGHEST for action port [ 597.316462] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 203b9bd0-a2b7-42e7-99a5-144533334f8a with Priority: HIGHEST for action port [ 597.316765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-203b9bd0-a2b7-42e7-99a5-144533334f8a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.316765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-203b9bd0-a2b7-42e7-99a5-144533334f8a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.316765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-203b9bd0-a2b7-42e7-99a5-144533334f8a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.316939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-203b9bd0-a2b7-42e7-99a5-144533334f8a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.316986] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('203b9bd0-a2b7-42e7-99a5-144533334f8a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.821213] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 203b9bd0-a2b7-42e7-99a5-144533334f8a [ 597.821213] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.821213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.821213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.821213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.821213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.821213] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:203b9bd0-a2b7-42e7-99a5-144533334f8a already deleted. [ 597.821488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-203b9bd0-a2b7-42e7-99a5-144533334f8a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.934354] env[66919]: INFO networking_nsxv3.common.synchronization [req-81bc0797-5de3-46cb-b321-66c73862c306 req-7180a006-1399-4f67-8374-40fdb6b777c9 tempest-ServerMetadataNegativeTestJSON-1926245434 tempest-ServerMetadataNegativeTestJSON-1926245434-project-member] Enqueued Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 597.934354] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 597.934354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.934354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.934354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.934354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.934354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.935359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.935359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.935359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.935359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.935359] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.053339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 598.054794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.115500] env[66919]: INFO networking_nsxv3.common.synchronization [req-a2304b46-100e-4915-886e-19cfa200524e req-1fadcd22-fea7-4144-8c08-271d54e59974 tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c with Priority: HIGHEST for action security_group_rules [ 598.118138] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c with Priority: HIGHEST for action security_group_rules [ 598.119997] env[66919]: INFO networking_nsxv3.common.synchronization [None req-7aba5d04-0940-47dc-a0d7-f9138cc43b10 None None] Enqueued Resource ID: 2f53584d-884a-46ac-bd57-61b04c6caa5d with Priority: HIGHEST for action port [ 598.120769] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.120964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.121356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.121462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.121601] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.123957] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f53584d-884a-46ac-bd57-61b04c6caa5d with Priority: HIGHEST for action port [ 598.123957] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f53584d-884a-46ac-bd57-61b04c6caa5d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.123957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f53584d-884a-46ac-bd57-61b04c6caa5d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.123957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f53584d-884a-46ac-bd57-61b04c6caa5d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.124396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f53584d-884a-46ac-bd57-61b04c6caa5d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.124609] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f53584d-884a-46ac-bd57-61b04c6caa5d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.439012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.439893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.439893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.439893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.439893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.440307] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.440410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.440410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.440893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.441020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.441109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa already deleted. [ 598.441205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.488469] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-558 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.488469] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-558" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.488656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-558" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.488938] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-558" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.489205] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.489416] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.489579] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.489816] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.489975] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.490245] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.492793] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.492793] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.492793] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.492793] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.492793] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.492793] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.511522] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.511893] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.513835] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.513835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-558" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.513835] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.513835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.513835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.513835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.513835] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('909c7dca-ca06-41b7-9e16-a43d0d33e8c8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.626398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f53584d-884a-46ac-bd57-61b04c6caa5d [ 598.626398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.626398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.626398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.626854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.626854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.626854] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f53584d-884a-46ac-bd57-61b04c6caa5d already deleted. [ 598.626854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f53584d-884a-46ac-bd57-61b04c6caa5d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.647603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.647603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.647603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.647895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.647895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.648260] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c already deleted. [ 598.648260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec78f07d-ba27-47dd-a5d7-eaa5e1dd055c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.016066] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.016285] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.016409] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.016685] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.016831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.016989] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 not found, creating... [ 599.017255] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.017406] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.017519] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.017729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.017855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.018185] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.018280] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.018383] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.018579] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.018704] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.018834] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 is going to be created. [ 599.041807] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.041807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.041807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.041807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.041807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.041807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.699930] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3cdf9ae7-f064-410c-97ba-73eb8efdb421 None None] Enqueued Resource ID: 84e42b7b-009f-4f25-a571-073b2226d386 with Priority: HIGHEST for action port [ 599.700462] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84e42b7b-009f-4f25-a571-073b2226d386 with Priority: HIGHEST for action port [ 599.700763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-84e42b7b-009f-4f25-a571-073b2226d386 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.700878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84e42b7b-009f-4f25-a571-073b2226d386" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.700949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84e42b7b-009f-4f25-a571-073b2226d386" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.702507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84e42b7b-009f-4f25-a571-073b2226d386" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.702507] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84e42b7b-009f-4f25-a571-073b2226d386',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.760321] env[66919]: INFO networking_nsxv3.common.synchronization [req-81bc0797-5de3-46cb-b321-66c73862c306 req-73da72dd-33e1-40ed-9346-7f692ae019cf service nova] Enqueued Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_rules [ 599.760499] env[66919]: INFO networking_nsxv3.common.synchronization [req-81bc0797-5de3-46cb-b321-66c73862c306 req-73da72dd-33e1-40ed-9346-7f692ae019cf service nova] Enqueued Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 599.760710] env[66919]: INFO networking_nsxv3.common.synchronization [req-81bc0797-5de3-46cb-b321-66c73862c306 req-73da72dd-33e1-40ed-9346-7f692ae019cf service nova] Enqueued Resource ID: 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 with Priority: HIGHEST for action port [ 599.762308] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_rules [ 599.762308] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 599.762308] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 with Priority: HIGHEST for action port [ 599.762481] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.762610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.762693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.764336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.764336] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.765304] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.765442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.765494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.765776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.766658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.766658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.766658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.766828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.766828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.766928] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.768113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.768113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.768113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.768391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.768391] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('909c7dca-ca06-41b7-9e16-a43d0d33e8c8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.204661] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 84e42b7b-009f-4f25-a571-073b2226d386 [ 600.204896] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.204896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.204974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.205315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.205315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.205417] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:84e42b7b-009f-4f25-a571-073b2226d386 already deleted. [ 600.205447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84e42b7b-009f-4f25-a571-073b2226d386" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.252644] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b974ac7-a6cf-468b-a2dd-0cb0b6f22a93 req-3c5cf85e-fd57-4846-be36-10425f5c24ff tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 600.253273] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 600.253668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.253789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.253859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.254133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.254332] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.254535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.254535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.255010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.255010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.255010] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.272122] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.273200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.273423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.274555] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 with status ACTIVE [ 600.278057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.278057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.278275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.278332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.278386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.278834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.279014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.279014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.279139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.279225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.279413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.280376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.280511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.280684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.280767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.280971] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 909c7dca-ca06-41b7-9e16-a43d0d33e8c8 is going to be updated. [ 600.304581] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.304745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.304851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.305939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.305939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.305939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-909c7dca-ca06-41b7-9e16-a43d0d33e8c8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.348514] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a82fa715-95ff-43ff-be00-4e2e58bff4f1 None None] Enqueued Resource ID: 3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62 with Priority: HIGHEST for action port [ 600.348514] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62 with Priority: HIGHEST for action port [ 600.349134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.349716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.349716] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.547466] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.547669] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.547780] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.548233] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.548498] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.548766] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.548840] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.549059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.549212] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.549700] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.549700] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.549700] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.549700] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.550047] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.550223] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.550359] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.574204] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.574386] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.574524] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.574705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.575028] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-ede92b8a-55d2-4d50-995c-18498636a442 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.575203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.575319] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.575705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.575810] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede92b8a-55d2-4d50-995c-18498636a442',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.757707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.758193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.758419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.758780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.758986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.759389] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.759627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.759803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.760188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.760821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.760821] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd already deleted. [ 600.760821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.783664] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.855230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62 [ 600.855230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.855230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.855230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.855230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.855230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.855230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62 already deleted. [ 600.855230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eaa8cd0-1ea4-4757-b070-b1a03c1a3c62" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.079296] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.079503] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.079723] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.079996] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.080178] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.081173] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port ede92b8a-55d2-4d50-995c-18498636a442 not found, creating... [ 601.081173] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.081173] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.081173] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.081173] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.081595] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.081595] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.081729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.081857] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.082091] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.082242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.082382] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: ede92b8a-55d2-4d50-995c-18498636a442 is going to be created. [ 601.107869] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.107869] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.109807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.112138] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.112288] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.112557] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.286378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.286626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.286626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.286831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.286926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.287056] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa is going to be created. [ 601.316653] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.317217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.317217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.317217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.317501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.331998] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: UNINITIALIZED for 2s [ 601.493179] env[66919]: INFO networking_nsxv3.common.synchronization [None req-aff790fa-04aa-44a5-83ff-d544060ec5c5 tempest-ServersTestFqdnHostnames-742120818 tempest-ServersTestFqdnHostnames-742120818-project-member] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 601.493751] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 601.493991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.495845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.495977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.496275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.496429] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.802906] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b974ac7-a6cf-468b-a2dd-0cb0b6f22a93 req-62d5b4dd-58a5-48e5-a48a-e9a5230045fd service nova] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_rules [ 601.803260] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b974ac7-a6cf-468b-a2dd-0cb0b6f22a93 req-62d5b4dd-58a5-48e5-a48a-e9a5230045fd service nova] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 601.803260] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b974ac7-a6cf-468b-a2dd-0cb0b6f22a93 req-62d5b4dd-58a5-48e5-a48a-e9a5230045fd service nova] Enqueued Resource ID: ede92b8a-55d2-4d50-995c-18498636a442 with Priority: HIGHEST for action port [ 601.804114] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_rules [ 601.804260] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 601.804359] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ede92b8a-55d2-4d50-995c-18498636a442 with Priority: HIGHEST for action port [ 601.804659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.804838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.804838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.805121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.805223] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.806465] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.806695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.806755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.806903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.807075] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.807177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.807229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.807378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.807459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.807549] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.810759] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ede92b8a-55d2-4d50-995c-18498636a442 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.810759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.810759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.810759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.810759] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ede92b8a-55d2-4d50-995c-18498636a442',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.940250] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d2104c73-f640-4431-b784-16fc94e9d254 tempest-ServersTestFqdnHostnames-742120818 tempest-ServersTestFqdnHostnames-742120818-project-member] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 601.941378] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 601.941833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.941833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.021114] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.022564] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 already deleted. [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.022564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.022564] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.312923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.313079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.313904] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.314188] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ede92b8a-55d2-4d50-995c-18498636a442 with status ACTIVE [ 602.314406] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.314950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.315314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.315638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.315638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.315768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.315917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.316686] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ede92b8a-55d2-4d50-995c-18498636a442 is going to be updated. [ 602.350270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.350501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.350501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.351266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.351266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.351266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ede92b8a-55d2-4d50-995c-18498636a442" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.544570] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.544745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.545218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.545738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.546456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.546456] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 already deleted. [ 602.546456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.820860] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.939575] env[66919]: INFO networking_nsxv3.common.synchronization [req-1db0b6db-7147-434f-85b0-0867b1627a2e req-905c9013-22ad-4eb4-96f1-60834ebb34cf tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 602.939575] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 602.940611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.940714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.940767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.940976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.941215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.941338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.941403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.941570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.941658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.941754] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.324021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.324021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.324021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.324021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.324021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.324021] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be created. [ 603.326058] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.326227] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.326334] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.326584] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.326877] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.327056] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.327168] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.327728] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.327907] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.328451] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.328695] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.328695] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.328759] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.328871] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.329195] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.329195] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.342403] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c7e52a83-a7f4-44de-9c4a-5c56b8e4fb71 None None] Enqueued Resource ID: 4349615e-8bb8-4710-9e84-a1ecd08e1d7d with Priority: HIGHEST for action port [ 603.342678] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4349615e-8bb8-4710-9e84-a1ecd08e1d7d with Priority: HIGHEST for action port [ 603.343181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4349615e-8bb8-4710-9e84-a1ecd08e1d7d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.343310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4349615e-8bb8-4710-9e84-a1ecd08e1d7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.343377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4349615e-8bb8-4710-9e84-a1ecd08e1d7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.343752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4349615e-8bb8-4710-9e84-a1ecd08e1d7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.343826] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4349615e-8bb8-4710-9e84-a1ecd08e1d7d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.349301] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: SUCCESS [ 603.349547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.350283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.350502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.350779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.350928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.350928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.351282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.351282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.351282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.351429] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.355890] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.356086] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.356223] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.356397] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.356804] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.356995] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.357163] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.357518] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.357668] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.362071] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.362233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.362303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.362729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.362808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.377076] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: UNINITIALIZED for 2s [ 603.443807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.846623] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4349615e-8bb8-4710-9e84-a1ecd08e1d7d [ 603.846623] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.846623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.846623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.846623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.846623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.846623] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4349615e-8bb8-4710-9e84-a1ecd08e1d7d already deleted. [ 603.846623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4349615e-8bb8-4710-9e84-a1ecd08e1d7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.856470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.856470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.856470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.856470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.856470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.857240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.857240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.857240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.857240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.857240] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.866126] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.866126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.866126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.866126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.866309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.866309] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 not found, creating... [ 603.866569] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.866844] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.866844] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.867887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.867887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.867887] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.867887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.867887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.867887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.869208] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.869430] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 is going to be created. [ 603.894879] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.894879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.894879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.895269] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.895641] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.895786] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.947767] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.359061] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c70302e-70ac-434d-a62c-6cde4cb391fa: rpc.has_security_group_logging(os_id): False [ 604.377806] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.378024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.378024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.378249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.378338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.378530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.378632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.378695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.378844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.378921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.379124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.379219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.379279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.379416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.379489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.379669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.379762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.379822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.379958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.380064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.380187] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa is going to be created. [ 604.454243] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.454243] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.454243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.454243] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 604.468147] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: IN_PROGRESS for 2s [ 604.523095] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.523095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.523095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.523269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.523351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.534373] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 604.636809] env[66919]: INFO networking_nsxv3.common.synchronization [req-1db0b6db-7147-434f-85b0-0867b1627a2e req-cdce3191-af96-4169-a945-87e78e8f9686 service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 604.637036] env[66919]: INFO networking_nsxv3.common.synchronization [req-1db0b6db-7147-434f-85b0-0867b1627a2e req-cdce3191-af96-4169-a945-87e78e8f9686 service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 604.637213] env[66919]: INFO networking_nsxv3.common.synchronization [req-1db0b6db-7147-434f-85b0-0867b1627a2e req-cdce3191-af96-4169-a945-87e78e8f9686 service nova] Enqueued Resource ID: b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 with Priority: HIGHEST for action port [ 604.637782] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 604.637924] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 604.638640] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 with Priority: HIGHEST for action port [ 604.638982] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.639551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.639551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.639551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.639551] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.640582] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.640582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.640745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.640745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.640745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.640919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.640997] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.134660] env[66919]: INFO networking_nsxv3.common.synchronization [req-5df5fd9e-9e13-4ef3-b655-0aafcd9c76c4 req-c2bcc02f-48e7-464e-9da7-4fa7a36483dd tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 605.135281] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 605.135582] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.135762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.135874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.136415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.136657] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.136816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.136922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.137119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.137211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.137307] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.142622] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.142747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.148489] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 with status ACTIVE [ 605.148716] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.148870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.148951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.149233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.149322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.149704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.149704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.149704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.149973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.149973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.150376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.150519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.150637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.150886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.150992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.151104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74 is going to be updated. [ 605.175811] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.176025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.176108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.176363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.176515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.176922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b939b8a8-3f5f-4ae3-9cdd-27c70ad13e74" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.396420] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 605.397140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.397303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.397871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.397871] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.398515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.398515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.398515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.398515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.398515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.398515] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.534951] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-814 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.534951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-814" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.534951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-814" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.535112] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-814" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.535828] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.535828] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.536512] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.536512] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.536839] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.536947] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.537710] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.537710] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.537710] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.537710] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.537986] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.537986] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.558819] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.558819] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.559032] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.559175] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-814" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.559942] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-788267e3-6cc6-42fe-9400-2c8bac8bfd28 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.559942] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.559942] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.560114] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.560155] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788267e3-6cc6-42fe-9400-2c8bac8bfd28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.615570] env[66919]: INFO networking_nsxv3.common.synchronization [None req-dd6a146b-60fa-437f-97ec-a137530bb992 None None] Enqueued Resource ID: 9ddada4e-4db1-42e9-bb1b-936a9072d33e with Priority: HIGHEST for action port [ 605.616118] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ddada4e-4db1-42e9-bb1b-936a9072d33e with Priority: HIGHEST for action port [ 605.616530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ddada4e-4db1-42e9-bb1b-936a9072d33e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.616698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ddada4e-4db1-42e9-bb1b-936a9072d33e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.616808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ddada4e-4db1-42e9-bb1b-936a9072d33e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.617136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ddada4e-4db1-42e9-bb1b-936a9072d33e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.617242] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ddada4e-4db1-42e9-bb1b-936a9072d33e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.639969] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.640892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.640892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.640892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.640892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.640892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.641167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.641294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.641525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.641803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.641971] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d already deleted. [ 605.642137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.902230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.902230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.902230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.902911] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.902911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.902911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.902911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.902911] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.902911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.902911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.903145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.903145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.903211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.903264] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.064433] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.064759] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.064920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.065235] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.065527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.065592] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 788267e3-6cc6-42fe-9400-2c8bac8bfd28 not found, creating... [ 606.065844] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.066846] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.066846] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.066846] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.066846] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.066846] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.066846] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.067192] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.067399] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.067545] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.067731] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 is going to be created. [ 606.094211] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.094570] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.094773] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.095229] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.095590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.095967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.119972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ddada4e-4db1-42e9-bb1b-936a9072d33e [ 606.120382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.120602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.120737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.121106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.121281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.121464] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ddada4e-4db1-42e9-bb1b-936a9072d33e already deleted. [ 606.121616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ddada4e-4db1-42e9-bb1b-936a9072d33e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.406916] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 760a77bb-57f0-44e3-b609-b74fb3c191fd: rpc.has_security_group_logging(os_id): False [ 606.435144] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.435302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.435351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.436030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.436030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.436030] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.436384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.436384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.436384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.436384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.436554] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.436606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.436774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.436939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.437022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.437217] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.437317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.437370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.437505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.437583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.437666] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be created. [ 606.480574] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: SUCCESS [ 606.480861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.510668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.510975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.510975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.511229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.511472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.528343] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 606.546537] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 606.546726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.546946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.547254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.547494] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.547647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.547735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.547930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.548051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.548177] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.874295] env[66919]: INFO networking_nsxv3.common.synchronization [req-5df5fd9e-9e13-4ef3-b655-0aafcd9c76c4 req-82583dbe-2fba-4dab-9496-db7518e3e2b5 service nova] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 606.876155] env[66919]: INFO networking_nsxv3.common.synchronization [req-5df5fd9e-9e13-4ef3-b655-0aafcd9c76c4 req-82583dbe-2fba-4dab-9496-db7518e3e2b5 service nova] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 606.878447] env[66919]: INFO networking_nsxv3.common.synchronization [req-5df5fd9e-9e13-4ef3-b655-0aafcd9c76c4 req-82583dbe-2fba-4dab-9496-db7518e3e2b5 service nova] Enqueued Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 606.878447] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 606.878447] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 606.878447] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 606.878926] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.879165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.879329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.880030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.880150] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.881133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.881286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.881380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.881656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.881833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.882150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.882150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.882774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.882774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.882774] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.883340] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-788267e3-6cc6-42fe-9400-2c8bac8bfd28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.883479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.883568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.883747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.883908] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788267e3-6cc6-42fe-9400-2c8bac8bfd28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.053579] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.359638] env[66919]: INFO networking_nsxv3.common.synchronization [req-72192b2e-36a0-45c6-b2ab-7352144cbaca req-8c48a77b-ea0b-4ef7-bfb7-98de51255115 tempest-ServerDiagnosticsNegativeTest-2142655531 tempest-ServerDiagnosticsNegativeTest-2142655531-project-member] Enqueued Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 607.360193] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGHEST for action security_group_members [ 607.360494] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.360619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.360689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.360893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.362561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.362718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.362848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.363068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.363163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.363264] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.387852] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.387852] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.387852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.390763] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with status ACTIVE [ 607.390763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.390763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.390763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.390763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.390763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.391130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.391130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.391130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.391288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.391288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.391975] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.391975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.391975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.391975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.391975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.391975] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 is going to be updated. [ 607.418249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.418249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.418874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.418874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.418874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.418968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.556981] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.617047] env[66919]: INFO networking_nsxv3.common.synchronization [req-23d9394d-b623-4d6e-993f-a227a854260c req-1fafd178-c6d7-43d7-b949-dddf2a303171 tempest-ServerDiagnosticsTest-108375797 tempest-ServerDiagnosticsTest-108375797-project-member] Enqueued Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 607.617615] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGHEST for action security_group_members [ 607.617916] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.618242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.618334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.618540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.618930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.619155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.619272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.619438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.619527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.619625] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.842692] env[66919]: INFO networking_nsxv3.common.synchronization [req-6ca146ef-afc5-4fc3-b71c-8afb315e0fb9 req-24b0af7b-50c3-4c2e-abce-9c108e7c530e tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 607.843310] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 607.843558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.843685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.845540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.846948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.847141] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.847255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.847318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.847487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.847575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.847668] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.869868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.869868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.869868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.869868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.869868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.869868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.870334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.870334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.870334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.870334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.870334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e is going to be updated. [ 607.889506] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.908474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.908474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.908474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.908474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.908474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.920635] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: IN_PROGRESS for 2s [ 608.060234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.060234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.060234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.060234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.060234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.060595] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 608.111320] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.111470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.111556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.112295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.112295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.121695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.122421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.122421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.122421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.122625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.122774] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.122926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.122977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.123234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.123378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.123543] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 is going to be updated. [ 608.138532] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 608.174750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.174750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.174750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.174953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.175011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.191337] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: IN_PROGRESS for 2s [ 608.279174] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.279364] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.279479] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.279834] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.280491] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.280724] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.280855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.281167] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.281358] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.282073] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.282073] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.282073] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.282247] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.282348] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.282421] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.282549] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.318014] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.318537] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.318537] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.318537] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.319067] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-39a5b3fc-0fb6-4501-91d1-0cd4257df880 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.319067] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.319269] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.319856] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.319856] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a5b3fc-0fb6-4501-91d1-0cd4257df880',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.352504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.352757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.352757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.353090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.353090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.353254] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.353343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.353420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.353710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.353859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.353961] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 already deleted. [ 608.354249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.395017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.395164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.395210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.395456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.395558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.395663] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be created. [ 608.430234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.430234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.430234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.430234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.430234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.443541] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: UNINITIALIZED for 2s [ 608.540436] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 608.540649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.775116] env[66919]: INFO networking_nsxv3.common.synchronization [req-69595f35-10f0-403b-b843-93430e65f56a req-dc1ca43e-375c-4bf9-8863-1f5e90ab3ef3 tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: 44f54900-76c5-4c30-8bfb-9dd3577f0e12 with Priority: HIGHEST for action security_group_rules [ 608.775116] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44f54900-76c5-4c30-8bfb-9dd3577f0e12 with Priority: HIGHEST for action security_group_rules [ 608.775407] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-44f54900-76c5-4c30-8bfb-9dd3577f0e12 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.775530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-44f54900-76c5-4c30-8bfb-9dd3577f0e12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.775615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-44f54900-76c5-4c30-8bfb-9dd3577f0e12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.776093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-44f54900-76c5-4c30-8bfb-9dd3577f0e12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.776093] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('44f54900-76c5-4c30-8bfb-9dd3577f0e12',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.822181] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.822534] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.822534] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.822838] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.822931] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.823090] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 39a5b3fc-0fb6-4501-91d1-0cd4257df880 not found, creating... [ 608.823351] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.823506] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.823632] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.823881] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.824150] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.824373] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.824475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.824654] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.824755] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.825016] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.825016] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 39a5b3fc-0fb6-4501-91d1-0cd4257df880 is going to be created. [ 608.849997] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.850188] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.850309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.850648] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.850804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.851034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.311678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.311678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.311678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.311678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.311678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.311678] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 44f54900-76c5-4c30-8bfb-9dd3577f0e12 already deleted. [ 609.311678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-44f54900-76c5-4c30-8bfb-9dd3577f0e12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.598791] env[66919]: INFO networking_nsxv3.common.synchronization [req-6ca146ef-afc5-4fc3-b71c-8afb315e0fb9 req-31fbd297-f996-4a9c-b3a8-0f62277aa610 service nova] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 609.598791] env[66919]: INFO networking_nsxv3.common.synchronization [req-6ca146ef-afc5-4fc3-b71c-8afb315e0fb9 req-31fbd297-f996-4a9c-b3a8-0f62277aa610 service nova] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 609.599177] env[66919]: INFO networking_nsxv3.common.synchronization [req-6ca146ef-afc5-4fc3-b71c-8afb315e0fb9 req-31fbd297-f996-4a9c-b3a8-0f62277aa610 service nova] Enqueued Resource ID: 39a5b3fc-0fb6-4501-91d1-0cd4257df880 with Priority: HIGHEST for action port [ 609.599177] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_rules [ 609.599177] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 609.599274] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39a5b3fc-0fb6-4501-91d1-0cd4257df880 with Priority: HIGHEST for action port [ 609.599799] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.599970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.599970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.600184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.600366] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.601445] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.601604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.601604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.601754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.601885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.602066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.602066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.602178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.602259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.602354] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.603133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-39a5b3fc-0fb6-4501-91d1-0cd4257df880 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.605525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.605875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.605875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.605875] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39a5b3fc-0fb6-4501-91d1-0cd4257df880',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.863082] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5f2e2b4-6f13-4981-b5bd-3ea1d898f65c req-67df5ee6-8d92-4f9b-986c-5b18512c0064 tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 609.863664] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 609.864824] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.864969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.934256] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e in Status: SUCCESS [ 609.934256] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e deletion is rescheduled due to dependency. [ 609.934256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.107860] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.121724] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.122475] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 39a5b3fc-0fb6-4501-91d1-0cd4257df880 with status ACTIVE [ 610.122475] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.122663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.122663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.122889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.122998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.123216] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.123318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.123384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.123586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.123719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.124390] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.124390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.124390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.124390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.124390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.124869] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 39a5b3fc-0fb6-4501-91d1-0cd4257df880 is going to be updated. [ 610.159817] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.159817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.159817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.161278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.161278] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.161278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.161278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.161514] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.162733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.162733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.162733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.162733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.162733] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.170525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.170720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.170763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.171435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.171435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.171435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39a5b3fc-0fb6-4501-91d1-0cd4257df880" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.201911] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: IN_PROGRESS for 4s [ 610.454338] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 610.454562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.454872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.454956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.455151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.455273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.455338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.455495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.456525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.456525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.456525] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.623198] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.665191] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.665389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.665960] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.683786] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.684150] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.684714] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.684714] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.684933] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.685107] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.685200] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.685483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.685602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.685702] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.685845] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.685951] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.686051] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.686160] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.686263] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.686383] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.707129] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.707307] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.707442] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.707762] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.708089] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-9637ee48-b07c-4f74-b058-bba560da751a taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.708280] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.708359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.708686] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.708843] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9637ee48-b07c-4f74-b058-bba560da751a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.955207] env[66919]: INFO networking_nsxv3.common.synchronization [None req-58d22908-3842-4550-a450-66ece0c0c62d None None] Enqueued Resource ID: a920fad6-bf31-4f33-9811-0da2b5231de9 with Priority: HIGHEST for action port [ 610.955742] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a920fad6-bf31-4f33-9811-0da2b5231de9 with Priority: HIGHEST for action port [ 610.956113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a920fad6-bf31-4f33-9811-0da2b5231de9 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.956246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a920fad6-bf31-4f33-9811-0da2b5231de9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.956339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a920fad6-bf31-4f33-9811-0da2b5231de9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.956583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a920fad6-bf31-4f33-9811-0da2b5231de9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.956667] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a920fad6-bf31-4f33-9811-0da2b5231de9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.957647] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.130985] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.131209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.131274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.131489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.131594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.131714] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 is going to be created. [ 611.159024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.159024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.159024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.159024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.159325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.168180] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.173954] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: UNINITIALIZED for 2s [ 611.212994] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.212994] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.212994] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.212994] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.212994] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.212994] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 9637ee48-b07c-4f74-b058-bba560da751a not found, creating... [ 611.212994] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.214508] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.214508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.214770] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.214770] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 9637ee48-b07c-4f74-b058-bba560da751a is going to be created. [ 611.242268] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.242531] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.242633] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.242995] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.243502] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.243671] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.459074] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a920fad6-bf31-4f33-9811-0da2b5231de9 [ 611.459329] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.459470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.459544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.459854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.459854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.459967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a920fad6-bf31-4f33-9811-0da2b5231de9 already deleted. [ 611.459997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a920fad6-bf31-4f33-9811-0da2b5231de9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.460242] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11de85e1-8fdb-4cd8-898c-db27313f960d: rpc.has_security_group_logging(os_id): False [ 611.484592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.485203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.485203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.485338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.485475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.486455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.486455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.486455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.493867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.493985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.493985] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be created. [ 611.576962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.576962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.576962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.576962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.576962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.587321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 611.671367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.671757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.671757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.671842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.671898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.672015] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 611.721662] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.722070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.722070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.722218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.722318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.749094] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 612.046499] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5f2e2b4-6f13-4981-b5bd-3ea1d898f65c req-45ae5e0d-8b8b-475a-996e-a57ff7bb7c75 service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 612.046718] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5f2e2b4-6f13-4981-b5bd-3ea1d898f65c req-45ae5e0d-8b8b-475a-996e-a57ff7bb7c75 service nova] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 612.046869] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5f2e2b4-6f13-4981-b5bd-3ea1d898f65c req-45ae5e0d-8b8b-475a-996e-a57ff7bb7c75 service nova] Enqueued Resource ID: 9637ee48-b07c-4f74-b058-bba560da751a with Priority: HIGHEST for action port [ 612.048650] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_rules [ 612.048802] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 612.048903] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9637ee48-b07c-4f74-b058-bba560da751a with Priority: HIGHEST for action port [ 612.049230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.049340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.049537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.049622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.049974] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9637ee48-b07c-4f74-b058-bba560da751a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.049974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.049974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.050436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.050526] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9637ee48-b07c-4f74-b058-bba560da751a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.218868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4689714c-abe3-425f-b780-ee3049d244c0 in Status: SUCCESS [ 612.218868] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 deletion is rescheduled due to dependency. [ 612.218868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.553277] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9637ee48-b07c-4f74-b058-bba560da751a with status ACTIVE [ 612.553520] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.553665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.553731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.554018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.554121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.554806] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.554806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.554806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.554806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.554806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.555043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.555043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.555122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.555228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.555310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.555397] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9637ee48-b07c-4f74-b058-bba560da751a is going to be updated. [ 612.587947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.588164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.588221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.588558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.588648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.588823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9637ee48-b07c-4f74-b058-bba560da751a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.835319] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa70e293-216c-4c2e-9bc0-bf9ec58655b6 req-79889e8b-dd93-4fd3-8c8c-f59970470b5a tempest-VolumesAssistedSnapshotsTest-235246620 tempest-VolumesAssistedSnapshotsTest-235246620-project-member] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 612.838065] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 612.840730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.840979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.841100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.841502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.841941] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.842140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.842830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.842830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.842830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.842830] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.157858] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4a77aa71-3e01-48d3-a997-205954460c7e None None] Enqueued Resource ID: 39d7250e-ffcc-4592-bbf6-f841bf78edd1 with Priority: HIGHEST for action port [ 613.159455] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 39d7250e-ffcc-4592-bbf6-f841bf78edd1 with Priority: HIGHEST for action port [ 613.160623] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-39d7250e-ffcc-4592-bbf6-f841bf78edd1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.162021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-39d7250e-ffcc-4592-bbf6-f841bf78edd1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.162021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-39d7250e-ffcc-4592-bbf6-f841bf78edd1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.162021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-39d7250e-ffcc-4592-bbf6-f841bf78edd1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.162021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('39d7250e-ffcc-4592-bbf6-f841bf78edd1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.191056] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: SUCCESS [ 613.191319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.191470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.191713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.191930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.192085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.192199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.192309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.192389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.192495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.192585] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.348577] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.351318] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.351318] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b already deleted. [ 613.351318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.378211] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-567 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.378211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-567" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.378211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-567" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.382036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-567" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.382036] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.382036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.382036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.382036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.382036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.382036] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.382036] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.382036] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.382036] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.383549] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.384030] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.384431] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.413795] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.413795] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.413795] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.413795] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-567" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.413795] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-8f41ede0-a9f7-4c59-8474-b68a92f80f39 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.414149] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.414149] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.414986] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.414986] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f41ede0-a9f7-4c59-8474-b68a92f80f39',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.603483] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 613.603483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.666335] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 39d7250e-ffcc-4592-bbf6-f841bf78edd1 [ 613.667981] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.667981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.667981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.667981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.667981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.667981] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:39d7250e-ffcc-4592-bbf6-f841bf78edd1 already deleted. [ 613.667981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-39d7250e-ffcc-4592-bbf6-f841bf78edd1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.698216] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.765162] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 613.765383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.765561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.765768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.766015] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.766189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.766244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.766428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.766521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.767278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.767278] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.767278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.767278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.767278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.767278] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.767537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.767537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.767537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.767625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.767703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.767765] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.771717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.771809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.773797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.773797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.773797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.773797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.773797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.773797] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.918510] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.918510] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.918950] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.918950] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.919828] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.919828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 8f41ede0-a9f7-4c59-8474-b68a92f80f39 not found, creating... [ 613.919828] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.919828] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.919828] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.920120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.920120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.920745] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.920745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.920745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.920745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.920977] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.920977] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 8f41ede0-a9f7-4c59-8474-b68a92f80f39 is going to be created. [ 613.942103] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.942351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.942545] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.942972] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.944157] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.944157] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.948816] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a5d08c93-0a5c-4999-a36e-f4c9f72cef45 None None] Enqueued Resource ID: 744f0f80-8d0f-4333-8539-555f1b9be775 with Priority: HIGHEST for action port [ 613.949501] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 744f0f80-8d0f-4333-8539-555f1b9be775 with Priority: HIGHEST for action port [ 613.950238] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-744f0f80-8d0f-4333-8539-555f1b9be775 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.950405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-744f0f80-8d0f-4333-8539-555f1b9be775" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.950497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-744f0f80-8d0f-4333-8539-555f1b9be775" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.950795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-744f0f80-8d0f-4333-8539-555f1b9be775" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.951545] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('744f0f80-8d0f-4333-8539-555f1b9be775',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.200074] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 349962c6-3abc-4bf7-9059-df3d43836eb4: rpc.has_security_group_logging(os_id): False [ 614.227017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.227017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.227017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.227017] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 is going to be created. [ 614.277187] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008: rpc.has_security_group_logging(os_id): False [ 614.278471] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.304782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.305361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.305514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.305765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.305981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.306305] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.306472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.306573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.306718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.306802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.307157] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.307246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.307246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.308659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.308659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.308659] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 614.328909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.330091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.330091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.330091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.330091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.342604] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: IN_PROGRESS for 2s [ 614.412070] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.412238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.412304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.412590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.412747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.438595] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 614.453511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 744f0f80-8d0f-4333-8539-555f1b9be775 [ 614.453782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.453977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.453977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.454207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.454302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.454424] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:744f0f80-8d0f-4333-8539-555f1b9be775 already deleted. [ 614.454736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-744f0f80-8d0f-4333-8539-555f1b9be775" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.679394] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa70e293-216c-4c2e-9bc0-bf9ec58655b6 req-086126a6-cc7b-41df-af22-86e8fe8f7bb2 service nova] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 614.679600] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa70e293-216c-4c2e-9bc0-bf9ec58655b6 req-086126a6-cc7b-41df-af22-86e8fe8f7bb2 service nova] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 614.679748] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa70e293-216c-4c2e-9bc0-bf9ec58655b6 req-086126a6-cc7b-41df-af22-86e8fe8f7bb2 service nova] Enqueued Resource ID: 8f41ede0-a9f7-4c59-8474-b68a92f80f39 with Priority: HIGHEST for action port [ 614.680347] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_rules [ 614.680486] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 614.680584] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f41ede0-a9f7-4c59-8474-b68a92f80f39 with Priority: HIGHEST for action port [ 614.680879] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.680969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.681048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.681296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.681387] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.686022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.686022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.686022] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.686022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f41ede0-a9f7-4c59-8474-b68a92f80f39 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.686022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.686022] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f41ede0-a9f7-4c59-8474-b68a92f80f39',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.780776] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.798601] env[66919]: INFO networking_nsxv3.common.synchronization [req-5dc1dd3d-4466-46d1-a154-9873e1e28282 req-9f36342f-ba19-44ad-ab95-3c2e397d16ca tempest-ImagesOneServerTestJSON-1342717248 tempest-ImagesOneServerTestJSON-1342717248-project-member] Enqueued Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 614.802434] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 614.802434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.802434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.802434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.802434] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.187457] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.188690] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f41ede0-a9f7-4c59-8474-b68a92f80f39 with status ACTIVE [ 615.188888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.189621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.189621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.189621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.189848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.189848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.190209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.190209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.190288] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.190490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.190490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.190643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.190720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.190807] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f41ede0-a9f7-4c59-8474-b68a92f80f39 is going to be updated. [ 615.192242] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.192354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.229965] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.229965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.230173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.230278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.230732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.230732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f41ede0-a9f7-4c59-8474-b68a92f80f39" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.278904] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.279596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-959" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.279596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-959" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.279744] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-959" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.279940] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.280149] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.280285] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.280539] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.280705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.280931] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.281074] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.281196] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.281322] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.281456] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.281568] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.281856] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.283441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.283612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.284090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.284090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.284090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.284220] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 615.308464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.308688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.308688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.308998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.309119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.309359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.310089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.310089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.310089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.310089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.310089] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a already deleted. [ 615.310089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.338972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.339934] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.339934] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.339934] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-959" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.339934] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.339934] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.340213] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.340349] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.340483] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d3dcb9-034f-40a6-85dc-1a60a1c2532d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.393587] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.393805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.393981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.394110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.394260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.413679] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 615.693530] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.844040] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.844347] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.844470] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.844770] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.844912] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.845079] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 32d3dcb9-034f-40a6-85dc-1a60a1c2532d not found, creating... [ 615.845388] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.845543] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.847036] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.847036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.847405] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 32d3dcb9-034f-40a6-85dc-1a60a1c2532d is going to be created. [ 615.889319] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.890299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.890299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.890299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.890299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.890452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.196690] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.197043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.197043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.197228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.197348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.197462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b is going to be created. [ 616.254402] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.254617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.254617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.255153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.255153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.281228] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: UNINITIALIZED for 2s [ 616.362865] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: SUCCESS [ 616.362865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.461887] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 616.462141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.462326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.462560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.462638] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [req-5dc1dd3d-4466-46d1-a154-9873e1e28282 req-5546f821-41be-4bcb-b780-144d1c7b00ba service nova] Enqueued Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_rules [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [req-5dc1dd3d-4466-46d1-a154-9873e1e28282 req-5546f821-41be-4bcb-b780-144d1c7b00ba service nova] Enqueued Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [req-5dc1dd3d-4466-46d1-a154-9873e1e28282 req-5546f821-41be-4bcb-b780-144d1c7b00ba service nova] Enqueued Resource ID: 32d3dcb9-034f-40a6-85dc-1a60a1c2532d with Priority: HIGHEST for action port [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_rules [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 616.589246] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32d3dcb9-034f-40a6-85dc-1a60a1c2532d with Priority: HIGHEST for action port [ 616.589979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.590275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.590457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.590808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.591092] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.592149] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.592525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.592705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.592976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.593242] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.593513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.593737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.594021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.596037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.596037] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.596037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.596037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.596037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.596037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.596037] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32d3dcb9-034f-40a6-85dc-1a60a1c2532d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.966133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.966133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.990211] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a6d5c54a-3010-4f1d-9110-f8f0a47a04fa None None] Enqueued Resource ID: 079a612f-f549-4d69-bca9-65c44ad91365 with Priority: HIGHEST for action port [ 616.991289] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 079a612f-f549-4d69-bca9-65c44ad91365 with Priority: HIGHEST for action port [ 616.991821] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-079a612f-f549-4d69-bca9-65c44ad91365 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.994024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-079a612f-f549-4d69-bca9-65c44ad91365" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.994024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-079a612f-f549-4d69-bca9-65c44ad91365" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.994024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-079a612f-f549-4d69-bca9-65c44ad91365" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.994024] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('079a612f-f549-4d69-bca9-65c44ad91365',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.098650] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.101284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.101284] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32d3dcb9-034f-40a6-85dc-1a60a1c2532d with status ACTIVE [ 617.101284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.101284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.101284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.102240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.102240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.102240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.102240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.102240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.102240] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32d3dcb9-034f-40a6-85dc-1a60a1c2532d is going to be updated. [ 617.130922] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.131138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.131374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.131446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.131684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.131849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32d3dcb9-034f-40a6-85dc-1a60a1c2532d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.410880] env[66919]: INFO networking_nsxv3.common.synchronization [req-cf66cc74-373a-476a-93ed-d69d05f04168 req-f6577bfb-931a-49ab-a255-02b9bad96b81 tempest-ServersTestFqdnHostnames-742120818 tempest-ServersTestFqdnHostnames-742120818-project-member] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 617.411698] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 617.412021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.413826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.413826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.414152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.414337] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.414752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.414752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.414752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.414752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.414928] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.427044] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 617.427282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.427454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.427766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.428017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.428175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.428306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.428455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.429560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.429560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.429560] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.500192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 079a612f-f549-4d69-bca9-65c44ad91365 [ 617.500263] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.500463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.500559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.500932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.501130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.501190] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:079a612f-f549-4d69-bca9-65c44ad91365 already deleted. [ 617.502703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-079a612f-f549-4d69-bca9-65c44ad91365" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.609791] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.897237] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.897498] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.897659] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.898324] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.898724] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.898972] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.899160] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.899436] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.899612] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.899885] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.900084] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.900241] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.900414] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.900514] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.900649] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.900865] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.919262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.919962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.919962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.919962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.919962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.920320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.920379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.920904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.920904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.920904] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 already deleted. [ 617.920904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.925190] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.925618] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.925836] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.926133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.926547] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-9ac41b6e-ae02-4254-be49-7891735e4931 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.926666] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.926791] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.927162] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.927297] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac41b6e-ae02-4254-be49-7891735e4931',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.930800] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.931148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.931274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.931535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.931726] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.931839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.931901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.932067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.932155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.932394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.932498] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.932644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.932725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.932912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.933091] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.933245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.933326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.933507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.933610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.933741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.933863] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.113259] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.113526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.113663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.114461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.114461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.114461] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a is going to be created. [ 618.155249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.155538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.156039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.156781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.157298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.192721] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: UNINITIALIZED for 2s [ 618.294104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: SUCCESS [ 618.294346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.294529] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.294757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.295020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.295142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.295255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.295536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.295644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.295740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.295837] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.433366] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.433366] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 9ac41b6e-ae02-4254-be49-7891735e4931 not found, creating... [ 618.433366] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.433366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.433979] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.434368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.434368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.434528] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.434661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.434817] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 9ac41b6e-ae02-4254-be49-7891735e4931 is going to be created. [ 618.437333] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008: rpc.has_security_group_logging(os_id): False [ 618.456107] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.456325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.456396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.456566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.456715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.457409] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.457409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.457409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.457971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.457971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.457971] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.457971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.457971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.458282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.458371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.458441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.458441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.458905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.458905] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 618.463308] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.463483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.463913] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.463913] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.464102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.464398] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.562332] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.562528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.562575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.562784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.562933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.626858] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 618.799560] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.239586] env[66919]: INFO networking_nsxv3.common.synchronization [req-cf66cc74-373a-476a-93ed-d69d05f04168 req-c2862ac3-3a70-4702-a565-8c143af69b8e service nova] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 619.239586] env[66919]: INFO networking_nsxv3.common.synchronization [req-cf66cc74-373a-476a-93ed-d69d05f04168 req-c2862ac3-3a70-4702-a565-8c143af69b8e service nova] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 619.239814] env[66919]: INFO networking_nsxv3.common.synchronization [req-cf66cc74-373a-476a-93ed-d69d05f04168 req-c2862ac3-3a70-4702-a565-8c143af69b8e service nova] Enqueued Resource ID: 9ac41b6e-ae02-4254-be49-7891735e4931 with Priority: HIGHEST for action port [ 619.240561] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_rules [ 619.240725] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 619.240725] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ac41b6e-ae02-4254-be49-7891735e4931 with Priority: HIGHEST for action port [ 619.241448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.241448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.241448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.241669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.241669] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.242688] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.242899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.242996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.243207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.243782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.243782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.243782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.243782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.243782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.244031] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.244914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ac41b6e-ae02-4254-be49-7891735e4931 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.245044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.245112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.245308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.245438] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ac41b6e-ae02-4254-be49-7891735e4931',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.303580] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d45aa44-8e7c-48b8-b926-f1958506fc0b: rpc.has_security_group_logging(os_id): False [ 619.333530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.333678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.333678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.334340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.334340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.335731] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.336013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.336075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.338282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.338282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.338282] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b is going to be created. [ 619.443294] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.443630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.443630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.444400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.444400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.465984] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: IN_PROGRESS for 2s [ 619.738986] env[66919]: INFO networking_nsxv3.common.synchronization [req-4a354351-6473-4902-b78a-c88c522dfd05 req-90fbc575-1aa1-48f0-9a78-84668dbd3e0f tempest-FloatingIPsAssociationTestJSON-1688354250 tempest-FloatingIPsAssociationTestJSON-1688354250-project-member] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 619.739438] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 619.739963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.739963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.740144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.740250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.740431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.740545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.740599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.740761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.740855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.740951] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.746952] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.747135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.748387] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.749208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ac41b6e-ae02-4254-be49-7891735e4931 with status ACTIVE [ 619.749450] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.749578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.749636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.749838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.749928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.750113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.750397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.750510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.750924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.750924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.750924] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.752315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.752392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.752556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.752635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.752723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ac41b6e-ae02-4254-be49-7891735e4931 is going to be updated. [ 619.790067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.790067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.790067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.790067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.790067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.790067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ac41b6e-ae02-4254-be49-7891735e4931" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.210152] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: SUCCESS [ 620.210418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.210617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.210874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.211035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.211148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.211205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.211564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.211564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.211564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.211709] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.221872] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.222124] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.222242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.222473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.222741] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.222973] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.225427] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.225640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.225640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.225835] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.225944] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.226090] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.226208] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.226319] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.226427] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.226554] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.245886] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.254236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.254613] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.254793] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.254974] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-107" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.255302] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-9f58b039-3a8b-4029-8182-034c217340af taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.255471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.255577] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.256623] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.256827] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f58b039-3a8b-4029-8182-034c217340af',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.257946] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.680625] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 620.681043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.715571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.715802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.715802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.716065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.716256] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.716373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.716419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.716594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.716672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.716765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.716912] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.717048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.717122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.717257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.717394] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.717486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.717545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.717753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.717753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.717848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.717920] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.750819] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.761646] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.762048] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.762369] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.762949] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.762949] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.762949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 9f58b039-3a8b-4029-8182-034c217340af not found, creating... [ 620.763936] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.763936] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.763936] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.763936] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.763936] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.765566] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.765566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.765566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.765566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.765566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.765566] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 9f58b039-3a8b-4029-8182-034c217340af is going to be created. [ 620.766373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.766539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.766587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.766913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.767024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.767147] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 is going to be created. [ 620.801762] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.802083] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.802303] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.802442] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.802662] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.802886] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.813757] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.813916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.814041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.814239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.814395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.827386] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: UNINITIALIZED for 2s [ 621.219774] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 92110755-d0a0-45ce-81ab-f52b3527b07a: rpc.has_security_group_logging(os_id): False [ 621.242097] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.242097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.242516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.242551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.242719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.243528] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.243699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.243772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.244041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.244170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.244396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.244512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.244643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.244808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.244895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.245125] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.245221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.245583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.245583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.245583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.245583] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a is going to be created. [ 621.253580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.253742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.253814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.254074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.254166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.254267] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be updated. [ 621.321515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.321678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.321721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.322012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.322628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.349643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 621.377909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.377909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.377909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.377909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.377909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.402895] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: IN_PROGRESS for 2s [ 621.484764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: SUCCESS [ 621.485464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.607532] env[66919]: INFO networking_nsxv3.common.synchronization [req-4a354351-6473-4902-b78a-c88c522dfd05 req-e81dd49f-ad63-4330-834e-5ad5a015e3a6 service nova] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_rules [ 621.607767] env[66919]: INFO networking_nsxv3.common.synchronization [req-4a354351-6473-4902-b78a-c88c522dfd05 req-e81dd49f-ad63-4330-834e-5ad5a015e3a6 service nova] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 621.607976] env[66919]: INFO networking_nsxv3.common.synchronization [req-4a354351-6473-4902-b78a-c88c522dfd05 req-e81dd49f-ad63-4330-834e-5ad5a015e3a6 service nova] Enqueued Resource ID: 9f58b039-3a8b-4029-8182-034c217340af with Priority: HIGHEST for action port [ 621.608744] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_rules [ 621.608808] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 621.609121] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f58b039-3a8b-4029-8182-034c217340af with Priority: HIGHEST for action port [ 621.609495] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.609714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.609796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.609989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.610098] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.611746] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.611833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.612142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f58b039-3a8b-4029-8182-034c217340af taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.612273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.612328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.612508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.612935] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f58b039-3a8b-4029-8182-034c217340af',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.116579] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.117015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.117015] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9f58b039-3a8b-4029-8182-034c217340af with status ACTIVE [ 622.117210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.117210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.117295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.117521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.117628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.117802] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.117924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.118079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.118172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.118263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.118473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.118572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.118695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.118894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.118894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.118979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9f58b039-3a8b-4029-8182-034c217340af is going to be updated. [ 622.150782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.150980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.151101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.151368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.151558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.151781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f58b039-3a8b-4029-8182-034c217340af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.229754] env[66919]: INFO networking_nsxv3.common.synchronization [None req-adea4f59-e124-4109-a672-8c0d967dfd8e None None] Enqueued Resource ID: f8952b24-f871-45c3-a4f3-8bb628d9cb31 with Priority: HIGHEST for action port [ 622.230355] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8952b24-f871-45c3-a4f3-8bb628d9cb31 with Priority: HIGHEST for action port [ 622.230924] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8952b24-f871-45c3-a4f3-8bb628d9cb31 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.230924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8952b24-f871-45c3-a4f3-8bb628d9cb31" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.230924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8952b24-f871-45c3-a4f3-8bb628d9cb31" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.231190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8952b24-f871-45c3-a4f3-8bb628d9cb31" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.231276] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8952b24-f871-45c3-a4f3-8bb628d9cb31',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.733818] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8952b24-f871-45c3-a4f3-8bb628d9cb31 [ 622.733967] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.734091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.734166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.735196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.735196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.735196] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8952b24-f871-45c3-a4f3-8bb628d9cb31 already deleted. [ 622.735196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8952b24-f871-45c3-a4f3-8bb628d9cb31" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.839443] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: SUCCESS [ 622.839744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.839949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.840732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.840732] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.840732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.840732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.840922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.840953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.841043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.841147] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.343797] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.359805] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.361351] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.361351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.362440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.362440] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.422771] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: SUCCESS [ 623.423465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.847354] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c5cd8d4c-0799-476c-99a4-61a972ef02e0: rpc.has_security_group_logging(os_id): False [ 623.869426] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.884368] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.884594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.884594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.884782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.884869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.885124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.885227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.885302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.885437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.885508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.885601] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 is going to be created. [ 623.988412] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.988856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.988856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.988978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.991109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.004242] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: IN_PROGRESS for 2s [ 624.371877] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.879600] env[66919]: INFO networking_nsxv3.common.synchronization [req-c95230f9-b6d8-4ebc-b519-f07f3f28b6f5 req-b9860b64-998c-4389-86e9-bbe221b80f07 tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: 9c47b191-a0b8-4f91-8d1c-8b4ea052528d with Priority: HIGHEST for action security_group_rules [ 624.879600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.879600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.879600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.879600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.879600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.879600] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be updated. [ 624.879600] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c47b191-a0b8-4f91-8d1c-8b4ea052528d with Priority: HIGHEST for action security_group_rules [ 624.880185] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c47b191-a0b8-4f91-8d1c-8b4ea052528d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.880185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c47b191-a0b8-4f91-8d1c-8b4ea052528d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.880185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c47b191-a0b8-4f91-8d1c-8b4ea052528d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.880447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c47b191-a0b8-4f91-8d1c-8b4ea052528d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.880586] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c47b191-a0b8-4f91-8d1c-8b4ea052528d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.888235] env[66919]: INFO networking_nsxv3.common.synchronization [None req-36376592-1b95-4598-9574-aa07224db9b5 None None] Enqueued Resource ID: 15f3b185-23d9-4b31-8acd-987334dc243a with Priority: HIGHEST for action port [ 624.888235] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15f3b185-23d9-4b31-8acd-987334dc243a with Priority: HIGHEST for action port [ 624.890306] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-15f3b185-23d9-4b31-8acd-987334dc243a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.890306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15f3b185-23d9-4b31-8acd-987334dc243a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.890306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15f3b185-23d9-4b31-8acd-987334dc243a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.890306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15f3b185-23d9-4b31-8acd-987334dc243a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.890306] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15f3b185-23d9-4b31-8acd-987334dc243a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.967750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.967750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.967750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.967750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.967750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.982106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 625.394246] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15f3b185-23d9-4b31-8acd-987334dc243a [ 625.394246] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.394246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.394246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.394246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.394246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.394246] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15f3b185-23d9-4b31-8acd-987334dc243a already deleted. [ 625.394246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15f3b185-23d9-4b31-8acd-987334dc243a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.408266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.409979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.410196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.410568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.410707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.411347] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c47b191-a0b8-4f91-8d1c-8b4ea052528d already deleted. [ 625.411651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c47b191-a0b8-4f91-8d1c-8b4ea052528d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.017333] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: SUCCESS [ 626.017563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.388925] env[66919]: INFO networking_nsxv3.common.synchronization [None req-af4cf665-f7ad-4675-8250-9f0ef63dd9ea None None] Enqueued Resource ID: 223add64-65e0-4375-a922-8e4fa39be1d7 with Priority: HIGHEST for action port [ 626.389549] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 223add64-65e0-4375-a922-8e4fa39be1d7 with Priority: HIGHEST for action port [ 626.390049] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-223add64-65e0-4375-a922-8e4fa39be1d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.390049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-223add64-65e0-4375-a922-8e4fa39be1d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.390049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-223add64-65e0-4375-a922-8e4fa39be1d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.390334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-223add64-65e0-4375-a922-8e4fa39be1d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.390420] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('223add64-65e0-4375-a922-8e4fa39be1d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.893382] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 223add64-65e0-4375-a922-8e4fa39be1d7 [ 626.893860] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.893860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.893860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.894084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.894460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.894784] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:223add64-65e0-4375-a922-8e4fa39be1d7 already deleted. [ 626.895823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-223add64-65e0-4375-a922-8e4fa39be1d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.999082] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 626.999318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.999505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.999730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.999925] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.000056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.000122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.000522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.000522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.000522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.000522] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.031265] env[66919]: INFO networking_nsxv3.common.synchronization [req-1a138853-524b-4c7d-a296-30844f6d73fe req-3cc9e49b-f803-48de-9178-7fa05e11bd18 tempest-ImagesNegativeTestJSON-1534095671 tempest-ImagesNegativeTestJSON-1534095671-project-member] Enqueued Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 627.032085] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 627.032510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.032681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.032750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.033030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.033218] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.033350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.033425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.033597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.033685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.033796] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.506600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.506600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.506600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.506600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.506600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.507682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.507682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.507682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.507682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.507682] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.543058] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.543058] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.543058] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 already deleted. [ 627.543058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.907401] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.907833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.907912] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.908854] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.909299] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.909592] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.909744] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.910236] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.910321] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.910915] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.910915] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.910915] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.911056] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.911198] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.911406] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.911564] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.940833] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.940833] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.940833] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.940833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-41" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.941125] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.941220] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.941273] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.942068] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.942068] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.008580] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a88ee71-4c82-4813-b129-b022cced6be1: rpc.has_security_group_logging(os_id): False [ 628.036376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.037171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.037171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.037293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.037416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.037812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.037937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.038011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.038383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.038383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.038575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.038575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.038715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.038814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.038851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.039323] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.039540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.039540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.039873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.040088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.040147] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be updated. [ 628.152432] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.152629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.152688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.152939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.153197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.174862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 628.446047] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.446463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.446656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.447119] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.447389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.448814] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b not found, creating... [ 628.448814] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.448814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.448814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.449091] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.449194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.449705] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.450032] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.450238] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.450613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.451956] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.451956] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b is going to be created. [ 628.481870] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.481870] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.482109] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.482305] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.483999] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.484358] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.117246] env[66919]: INFO networking_nsxv3.common.synchronization [req-e18f504e-df57-4924-a113-b4635ca3da5f req-919de53f-6ca2-4831-a686-08c89457f122 tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 629.118202] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 629.119270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.119270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.119270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.119645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.119645] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.119645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.119852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.119905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.119957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.120127] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.306299] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f801bf1e-3d4b-4965-bce9-ce17862bc072 None None] Enqueued Resource ID: a992bb8a-bdb8-4720-9a78-2fde5e4325d1 with Priority: HIGHEST for action port [ 629.306700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a992bb8a-bdb8-4720-9a78-2fde5e4325d1 with Priority: HIGHEST for action port [ 629.309392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a992bb8a-bdb8-4720-9a78-2fde5e4325d1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.309967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a992bb8a-bdb8-4720-9a78-2fde5e4325d1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.310095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a992bb8a-bdb8-4720-9a78-2fde5e4325d1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.310351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a992bb8a-bdb8-4720-9a78-2fde5e4325d1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.310432] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a992bb8a-bdb8-4720-9a78-2fde5e4325d1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.345345] env[66919]: INFO networking_nsxv3.common.synchronization [req-1a138853-524b-4c7d-a296-30844f6d73fe req-feda43ee-c451-4803-83c1-4b74fd24cc97 service nova] Enqueued Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_rules [ 629.346343] env[66919]: INFO networking_nsxv3.common.synchronization [req-1a138853-524b-4c7d-a296-30844f6d73fe req-feda43ee-c451-4803-83c1-4b74fd24cc97 service nova] Enqueued Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 629.346343] env[66919]: INFO networking_nsxv3.common.synchronization [req-1a138853-524b-4c7d-a296-30844f6d73fe req-feda43ee-c451-4803-83c1-4b74fd24cc97 service nova] Enqueued Resource ID: cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b with Priority: HIGHEST for action port [ 629.346603] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_rules [ 629.346734] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 629.346828] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b with Priority: HIGHEST for action port [ 629.347111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.347233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.347318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.350191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.350191] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.350191] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.350435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.350580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.350746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.351108] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.351221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.351281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.351467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.351835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.351964] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.353113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.353222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.353283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.353507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.353582] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.626371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.626646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.626646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.626892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.627702] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.627991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.628353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.628353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.628471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.628552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.628657] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc already deleted. [ 629.628743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.812267] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a992bb8a-bdb8-4720-9a78-2fde5e4325d1 [ 629.812553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.812712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.812781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.813040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.813155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.813259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a992bb8a-bdb8-4720-9a78-2fde5e4325d1 already deleted. [ 629.813343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a992bb8a-bdb8-4720-9a78-2fde5e4325d1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.855225] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.856388] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.856477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.856603] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b with status ACTIVE [ 629.856768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.856879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.858678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.858678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.858678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.861370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.861502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.861611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.861690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.861777] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b is going to be updated. [ 629.891124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.891337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.891389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.891615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.891774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.891976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf508fe6-ef0a-49f2-a8dd-7aaa0272e28b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.197163] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 630.197505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218336] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.218336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.218336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.218732] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.219027] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.219273] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.219331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.219553] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.220691] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.220691] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.220691] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.220691] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.220691] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.220691] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.220691] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.220691] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.243408] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.243587] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.243747] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.243987] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.244417] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-befdcfd9-ab76-408d-97ed-d1432a88a388 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.244639] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.244797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.246302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.246931] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('befdcfd9-ab76-408d-97ed-d1432a88a388',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.364266] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.749701] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.749958] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.750129] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.750408] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.750554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.750701] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port befdcfd9-ab76-408d-97ed-d1432a88a388 not found, creating... [ 630.751092] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.751265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.751396] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.751630] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.751757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.752061] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752334] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.752541] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.752672] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.752821] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: befdcfd9-ab76-408d-97ed-d1432a88a388 is going to be created. [ 630.776612] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.776880] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.776945] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.777247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.777484] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.777703] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.869162] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.869162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.869162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.869162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.869162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.869162] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 is going to be created. [ 630.912179] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.912364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.912430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.912657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.912819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.928466] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: UNINITIALIZED for 2s [ 631.420092] env[66919]: INFO networking_nsxv3.common.synchronization [req-965dd713-7a0f-4003-94ec-7140b6407d39 req-d821824d-494a-4157-8700-48e9f531a3c1 tempest-ServersNegativeTestJSON-918520820 tempest-ServersNegativeTestJSON-918520820-project-member] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 631.420092] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 631.420496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.420496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.420496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.420947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.420947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.421110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.421110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.421238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.421292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.421380] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.530870] env[66919]: INFO networking_nsxv3.common.synchronization [req-e18f504e-df57-4924-a113-b4635ca3da5f req-0c77f961-c111-479f-9b6c-27f238094e12 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 631.530870] env[66919]: INFO networking_nsxv3.common.synchronization [req-e18f504e-df57-4924-a113-b4635ca3da5f req-0c77f961-c111-479f-9b6c-27f238094e12 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 631.530870] env[66919]: INFO networking_nsxv3.common.synchronization [req-e18f504e-df57-4924-a113-b4635ca3da5f req-0c77f961-c111-479f-9b6c-27f238094e12 service nova] Enqueued Resource ID: befdcfd9-ab76-408d-97ed-d1432a88a388 with Priority: HIGHEST for action port [ 631.531144] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 631.531144] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 631.531244] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: befdcfd9-ab76-408d-97ed-d1432a88a388 with Priority: HIGHEST for action port [ 631.531799] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.531921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.531985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.534405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.534509] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.537347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.537499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.538857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.538857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.538857] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.539927] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-befdcfd9-ab76-408d-97ed-d1432a88a388 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.539927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.539927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.540127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.540204] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('befdcfd9-ab76-408d-97ed-d1432a88a388',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.920813] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.921076] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.921161] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.921477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.921746] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.921950] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.922040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.923833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.924011] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.924680] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.924680] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.924680] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.924680] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.925096] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.925096] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.925096] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.926630] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.926772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.926839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.927121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.927230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.927704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.927863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.927932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.928134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.928342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.928441] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f already deleted. [ 631.928568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.952640] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.952840] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.953021] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.953232] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.953576] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-7973bd65-5921-4b70-ba51-2c2280eda717 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.953790] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.953918] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.954391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.958033] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7973bd65-5921-4b70-ba51-2c2280eda717',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.042647] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.042647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.044741] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.045241] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port befdcfd9-ab76-408d-97ed-d1432a88a388 with status ACTIVE [ 632.045241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.045333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.045378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.045578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.045675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.045843] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.045953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.046017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.046189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.046939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.046939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.046939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.046939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.047223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.047383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.047476] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: befdcfd9-ab76-408d-97ed-d1432a88a388 is going to be updated. [ 632.072514] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.072890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.073106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.073360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.073607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.073790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-befdcfd9-ab76-408d-97ed-d1432a88a388" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.457345] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.457345] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.457345] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.457750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.457978] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.458117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 7973bd65-5921-4b70-ba51-2c2280eda717 not found, creating... [ 632.458420] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.458603] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.458723] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.459139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.459212] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.459642] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.459642] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.459831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.459953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.460274] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.460274] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 7973bd65-5921-4b70-ba51-2c2280eda717 is going to be created. [ 632.511952] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.512440] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.512700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.513191] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.513560] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.513923] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.550519] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.939448] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: SUCCESS [ 632.939660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.939825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.940055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.940244] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.940356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.940420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.940571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.940645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.940724] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.940810] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.056996] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.057628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.057628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.057628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.057909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.057909] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be created. [ 633.085104] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.085302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.085302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.085516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.085644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.101643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: UNINITIALIZED for 2s [ 633.229771] env[66919]: INFO networking_nsxv3.common.synchronization [req-965dd713-7a0f-4003-94ec-7140b6407d39 req-57f45a76-f32d-461d-92fa-84292531eea6 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 633.230088] env[66919]: INFO networking_nsxv3.common.synchronization [req-965dd713-7a0f-4003-94ec-7140b6407d39 req-57f45a76-f32d-461d-92fa-84292531eea6 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 633.230317] env[66919]: INFO networking_nsxv3.common.synchronization [req-965dd713-7a0f-4003-94ec-7140b6407d39 req-57f45a76-f32d-461d-92fa-84292531eea6 service nova] Enqueued Resource ID: 7973bd65-5921-4b70-ba51-2c2280eda717 with Priority: HIGHEST for action port [ 633.230972] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 633.231769] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 633.231909] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7973bd65-5921-4b70-ba51-2c2280eda717 with Priority: HIGHEST for action port [ 633.232297] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.233109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.234143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.234143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.234143] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.235949] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.235949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.235949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.235949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.235949] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.235949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.235949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.237580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.237580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.237580] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.237580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7973bd65-5921-4b70-ba51-2c2280eda717 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.237798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.237798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.240032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.240032] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7973bd65-5921-4b70-ba51-2c2280eda717',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.444174] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.444344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.444447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.444662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.444848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.444981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.445044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.445202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.445296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.445386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.445538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.445649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.445717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.445864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.446013] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.446111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.446172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.446373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.446454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.446537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.446627] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.740520] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.741426] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.741535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.741688] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7973bd65-5921-4b70-ba51-2c2280eda717 with status ACTIVE [ 633.741844] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.741949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.742021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.742239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.742332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.742616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.742616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.743185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.743185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.743185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.745381] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.745381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.745381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.745381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.745556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.745587] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7973bd65-5921-4b70-ba51-2c2280eda717 is going to be updated. [ 633.772575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.772791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.772791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.773044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.773224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.773411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.949705] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7264374f-cfc2-4efe-a3e1-37e97b0370c2: rpc.has_security_group_logging(os_id): False [ 633.973029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.973029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.973200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.973778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.973778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.973895] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.974148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.974148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.974429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.974660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.974956] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.975496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.975496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.975496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.975627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.975784] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.975908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.975993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.976165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.976289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.976393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 is going to be created. [ 634.092044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.092044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.092044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.092044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.092044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.212546] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: IN_PROGRESS for 2s [ 634.248776] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.753375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.753695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.753695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.753882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.754273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.754273] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be created. [ 634.784099] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.784099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.784099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.784099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.784099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.798605] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: UNINITIALIZED for 2s [ 635.114373] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 635.114373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.114373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.115577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.115577] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.115577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.115577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.115577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.115951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.115951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.115951] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.620063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.620063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.620063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.620063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.620063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.620063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.620419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.620419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.620419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.620511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.620605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.620696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.620752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.620890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.621033] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.621132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.621202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.621304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.621373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.621449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.622781] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.989643] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c21b164b-c622-4858-9ce4-b316a532fee1 None None] Enqueued Resource ID: 37845060-98c6-41f4-b0a8-92afec6b7e0d with Priority: HIGHEST for action port [ 635.990719] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37845060-98c6-41f4-b0a8-92afec6b7e0d with Priority: HIGHEST for action port [ 635.990719] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-37845060-98c6-41f4-b0a8-92afec6b7e0d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.990993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37845060-98c6-41f4-b0a8-92afec6b7e0d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.990993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37845060-98c6-41f4-b0a8-92afec6b7e0d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.991489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37845060-98c6-41f4-b0a8-92afec6b7e0d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.991489] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37845060-98c6-41f4-b0a8-92afec6b7e0d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.127937] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c38fec75-1824-4123-9a27-d70b3e15c2bc: rpc.has_security_group_logging(os_id): False [ 636.150980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.151189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.151255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.151436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.151542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.151747] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.151937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.151937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.152080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.152158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.152158] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.152158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.152158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.152791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.152791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.152889] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.152945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.153299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.153461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.153639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.153639] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be created. [ 636.241571] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: SUCCESS [ 636.241997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.246189] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.246276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.246438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.246671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.249026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.259764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 636.494280] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37845060-98c6-41f4-b0a8-92afec6b7e0d [ 636.494852] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.494997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.496050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.496050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.496050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.496050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37845060-98c6-41f4-b0a8-92afec6b7e0d already deleted. [ 636.496050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37845060-98c6-41f4-b0a8-92afec6b7e0d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.810816] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 636.810940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.811100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.811325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.811519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.811640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.811706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.811852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.811933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.812073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.812109] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.316618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.316618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.316618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.316618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.316618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.318085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.318085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.318085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.318085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.318085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.318085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.319050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.319196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.319415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.319604] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.320311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.320311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.320311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.320311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.320311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.320311] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.824504] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54a8eb66-4aa1-440c-af86-e5e65121f69f: rpc.has_security_group_logging(os_id): False [ 637.844173] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.844374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.844437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.844658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.844751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.844964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.845103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.845175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.845349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.845427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.845641] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.845739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.845810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.845954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.846338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.846519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.846718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.846843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.847051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.847179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.847295] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be created. [ 637.933087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.933309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.933373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.933598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.933790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.956274] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 638.277443] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 638.278403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.412829] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ecf2a06c-9770-475c-8b28-4a8034f76355 None None] Enqueued Resource ID: 3560bb19-f013-495d-9da9-6d31ccbd1b13 with Priority: HIGHEST for action port [ 638.413283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3560bb19-f013-495d-9da9-6d31ccbd1b13 with Priority: HIGHEST for action port [ 638.413602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-3560bb19-f013-495d-9da9-6d31ccbd1b13 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.413747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3560bb19-f013-495d-9da9-6d31ccbd1b13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.413819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3560bb19-f013-495d-9da9-6d31ccbd1b13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.415749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3560bb19-f013-495d-9da9-6d31ccbd1b13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.415858] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3560bb19-f013-495d-9da9-6d31ccbd1b13',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.920648] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3560bb19-f013-495d-9da9-6d31ccbd1b13 [ 638.922029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.922029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.922029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.924708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.924708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.924708] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3560bb19-f013-495d-9da9-6d31ccbd1b13 already deleted. [ 638.924708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3560bb19-f013-495d-9da9-6d31ccbd1b13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.976305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 639.976734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.210303] env[66919]: INFO networking_nsxv3.common.synchronization [req-15c4a2ed-5bba-416a-a827-b2aeff242c63 req-9ed26f09-66b8-433e-baab-69f9ac48c8db tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 640.212124] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 640.216153] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.216153] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.216153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.216153] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.717490] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.717679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.717755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.717995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.718101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.718300] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.718404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.718486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.718599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.718682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.718772] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 already deleted. [ 640.718854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.730063] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.730297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.730375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.730702] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.731012] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.731211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.731368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.733926] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.733926] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.733926] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.733926] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.733926] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.733926] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.733926] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.733926] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.733926] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.772076] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.772383] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.772525] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.774417] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.774417] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-1752bf26-1a7b-4b42-96e2-16fdc61fb166 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.774417] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.774653] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.775029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.775466] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1752bf26-1a7b-4b42-96e2-16fdc61fb166',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.278050] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.278661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.278661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.278661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.278872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.279046] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 1752bf26-1a7b-4b42-96e2-16fdc61fb166 not found, creating... [ 641.279417] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.279640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.279782] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.280085] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.280272] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.280588] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.280967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.280967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.281596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.281761] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.281908] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 1752bf26-1a7b-4b42-96e2-16fdc61fb166 is going to be created. [ 641.312120] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.312684] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.312986] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.313418] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.313747] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.314221] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.499742] env[66919]: INFO networking_nsxv3.common.synchronization [None req-93f87975-60d0-4cb2-8a38-22308659949f None None] Enqueued Resource ID: 9d593ab8-0c9f-4ac8-a62b-a445659a2131 with Priority: HIGHEST for action port [ 641.500466] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d593ab8-0c9f-4ac8-a62b-a445659a2131 with Priority: HIGHEST for action port [ 641.501456] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d593ab8-0c9f-4ac8-a62b-a445659a2131 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.501456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d593ab8-0c9f-4ac8-a62b-a445659a2131" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.501456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d593ab8-0c9f-4ac8-a62b-a445659a2131" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.501456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d593ab8-0c9f-4ac8-a62b-a445659a2131" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.501456] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d593ab8-0c9f-4ac8-a62b-a445659a2131',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.006168] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d593ab8-0c9f-4ac8-a62b-a445659a2131 [ 642.006576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.006820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.006933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.007213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.007367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.007481] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d593ab8-0c9f-4ac8-a62b-a445659a2131 already deleted. [ 642.008611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d593ab8-0c9f-4ac8-a62b-a445659a2131" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.013307] env[66919]: INFO networking_nsxv3.common.synchronization [req-15c4a2ed-5bba-416a-a827-b2aeff242c63 req-2c308c28-0a0c-436c-9905-fc9a799245a8 service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 642.013497] env[66919]: INFO networking_nsxv3.common.synchronization [req-15c4a2ed-5bba-416a-a827-b2aeff242c63 req-2c308c28-0a0c-436c-9905-fc9a799245a8 service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 642.013959] env[66919]: INFO networking_nsxv3.common.synchronization [req-15c4a2ed-5bba-416a-a827-b2aeff242c63 req-2c308c28-0a0c-436c-9905-fc9a799245a8 service nova] Enqueued Resource ID: 1752bf26-1a7b-4b42-96e2-16fdc61fb166 with Priority: HIGHEST for action port [ 642.014500] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 642.014704] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 642.014791] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1752bf26-1a7b-4b42-96e2-16fdc61fb166 with Priority: HIGHEST for action port [ 642.015640] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.015838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.015979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.016199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.016343] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.017336] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.017457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.017519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.017821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.017990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.018413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.018413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.018413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.018567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.019640] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.021099] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1752bf26-1a7b-4b42-96e2-16fdc61fb166 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.021251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.021300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.021469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.021605] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1752bf26-1a7b-4b42-96e2-16fdc61fb166',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.524486] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.525718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.525868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.526107] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1752bf26-1a7b-4b42-96e2-16fdc61fb166 with status ACTIVE [ 642.526309] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.526450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.526524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.526793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.526916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.527529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.527649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.527718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.528289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.528289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.528431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.528499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.528538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.528744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.528836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.528992] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1752bf26-1a7b-4b42-96e2-16fdc61fb166 is going to be updated. [ 642.556305] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.556596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.556596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.556772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.556919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.559019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1752bf26-1a7b-4b42-96e2-16fdc61fb166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.032816] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.538085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.538394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.538394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.538530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.538623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.538736] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be created. [ 643.573594] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.573594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.573594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.575161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.575161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.578739] env[66919]: INFO networking_nsxv3.common.synchronization [req-bd707e0e-ea64-4115-be46-d411eede703e req-e7263ed0-8fa0-44d1-8694-2cffbb2b66ce tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 643.580354] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 643.580746] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4a6734-7330-47cc-9600-5eb1b1105162 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.580907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.581017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.581429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.581552] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4a6734-7330-47cc-9600-5eb1b1105162',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.587516] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: UNINITIALIZED for 2s [ 644.111988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.111988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.111988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.111988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.111988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.111988] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4a6734-7330-47cc-9600-5eb1b1105162 already deleted. [ 644.111988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.747898] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fdf14dd6-68e9-4185-8e91-4d9bf328d2f1 None None] Enqueued Resource ID: 16652a55-fcb4-4bc0-a28a-7c8e35c7ce13 with Priority: HIGHEST for action port [ 644.747898] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16652a55-fcb4-4bc0-a28a-7c8e35c7ce13 with Priority: HIGHEST for action port [ 644.748261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-16652a55-fcb4-4bc0-a28a-7c8e35c7ce13 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.749100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16652a55-fcb4-4bc0-a28a-7c8e35c7ce13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.749218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16652a55-fcb4-4bc0-a28a-7c8e35c7ce13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.750214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16652a55-fcb4-4bc0-a28a-7c8e35c7ce13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.750364] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16652a55-fcb4-4bc0-a28a-7c8e35c7ce13',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.255229] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16652a55-fcb4-4bc0-a28a-7c8e35c7ce13 [ 645.255488] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.255641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.255723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.256040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.256102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.256214] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16652a55-fcb4-4bc0-a28a-7c8e35c7ce13 already deleted. [ 645.256305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16652a55-fcb4-4bc0-a28a-7c8e35c7ce13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.292819] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e7102c88-2490-416f-8224-0e5375a4b24b None None] Enqueued Resource ID: 3e281429-bb6a-44db-bb8f-e03ae483a7e8 with Priority: HIGHEST for action port [ 645.293256] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e281429-bb6a-44db-bb8f-e03ae483a7e8 with Priority: HIGHEST for action port [ 645.294302] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e281429-bb6a-44db-bb8f-e03ae483a7e8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.294441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e281429-bb6a-44db-bb8f-e03ae483a7e8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.294500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e281429-bb6a-44db-bb8f-e03ae483a7e8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.295536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e281429-bb6a-44db-bb8f-e03ae483a7e8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.295536] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e281429-bb6a-44db-bb8f-e03ae483a7e8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.604766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 645.604766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.604897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.605192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.605480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.605639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.605708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.605884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.605969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.606069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.606162] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.731917] env[66919]: INFO networking_nsxv3.common.synchronization [req-e76ab92c-60ff-424a-ba4c-47561bfc0d5b req-c4c8850f-f601-4abb-87cf-a73a79067c35 tempest-ServerExternalEventsTest-1526113989 tempest-ServerExternalEventsTest-1526113989-project-member] Enqueued Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 645.733313] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 645.733770] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.734504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.735517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.735633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.735805] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.735928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.736032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.736221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.736310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.736797] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.796936] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e281429-bb6a-44db-bb8f-e03ae483a7e8 [ 645.797681] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.797965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.799378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.799378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.799378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.799378] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e281429-bb6a-44db-bb8f-e03ae483a7e8 already deleted. [ 645.799378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e281429-bb6a-44db-bb8f-e03ae483a7e8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.113551] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.113751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.113801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.114433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.114433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.114433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.114433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.114723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.114852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.114920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.115149] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.115149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.115269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.116322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.116466] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.116994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.119885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.120114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.120215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.120315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.120413] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.241131] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.242230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.242317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.242577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.242829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.243035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.243206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.243294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.243492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.243614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.243742] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f224771b-3e74-478f-8e84-a05495ab099b already deleted. [ 646.243858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.332741] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.332921] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.333052] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.333318] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.333644] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.333814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.333927] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.334186] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.334291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.334714] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.334714] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.334714] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.334844] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.334877] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.334980] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.335118] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.358342] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.358554] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.358828] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.360050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.360647] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.361243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.361384] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.361806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.362054] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d69c7c9-8c67-44fb-9b9f-9a181763dd95',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.623972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 646.645034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.645034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.645034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.645034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.645034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.645351] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.645351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.646261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.646261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.646261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.646261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.646261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.646542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.646542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.648587] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.648587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.648587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.651139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.651139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.651139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be created. [ 646.719372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.719587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.719634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.719822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.720009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.736660] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 646.864921] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.865267] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.865326] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.865917] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.866190] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.866496] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 not found, creating... [ 646.866974] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.867580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.869892] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.870704] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.870704] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.871240] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.871606] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.871851] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.872270] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.872516] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.872847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 is going to be created. [ 646.904570] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.904800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.904921] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.905233] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.905596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.906150] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.590198] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b0187df7-861c-4c4e-a1fd-66cd8a55e3cb None None] Enqueued Resource ID: 2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed with Priority: HIGHEST for action port [ 647.590884] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed with Priority: HIGHEST for action port [ 647.591262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.591399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.591511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.591725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.591809] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.725932] env[66919]: INFO networking_nsxv3.common.synchronization [req-e76ab92c-60ff-424a-ba4c-47561bfc0d5b req-ccc87ecd-8779-41fb-a354-c74e6b22fd7a service nova] Enqueued Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_rules [ 647.727269] env[66919]: INFO networking_nsxv3.common.synchronization [req-e76ab92c-60ff-424a-ba4c-47561bfc0d5b req-ccc87ecd-8779-41fb-a354-c74e6b22fd7a service nova] Enqueued Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 647.727584] env[66919]: INFO networking_nsxv3.common.synchronization [req-e76ab92c-60ff-424a-ba4c-47561bfc0d5b req-ccc87ecd-8779-41fb-a354-c74e6b22fd7a service nova] Enqueued Resource ID: 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 with Priority: HIGHEST for action port [ 647.728985] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_rules [ 647.729228] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 647.729397] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 with Priority: HIGHEST for action port [ 647.729819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.730026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.730129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.730515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.730630] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.733633] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.734814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.734814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.734814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.734814] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.735033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.735129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.735372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.735527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.735687] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.737378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.737611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.737684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.737916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.738040] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d69c7c9-8c67-44fb-9b9f-9a181763dd95',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.842791] env[66919]: INFO networking_nsxv3.common.synchronization [req-1cdc9a77-9641-4af9-b676-e4ff530c2a35 req-e3f33fc7-950d-4d0f-8b35-d6c9259b07cf tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 647.845061] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 647.845061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.845061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.845061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.845061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.845061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.845061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.845061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.845961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.845961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.845961] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.099026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed [ 648.099026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.099026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.099026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.099026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.099026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.099026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed already deleted. [ 648.099026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d7de8ef-a6bf-4e4e-9a14-cdb4a72ba6ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.240279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.244022] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.244022] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 with status ACTIVE [ 648.244022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.244022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.244022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.245436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.246058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.246334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.246843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.247206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.247851] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d69c7c9-8c67-44fb-9b9f-9a181763dd95 is going to be updated. [ 648.282526] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.282730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.282814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.283443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.283630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.283849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d69c7c9-8c67-44fb-9b9f-9a181763dd95" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.353072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.353072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.353072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.353072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 648.398347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.398347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.398614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.400550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.400550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.420326] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 648.750612] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.758914] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 648.758914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.255932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.257081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.257081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.257081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.257081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.257081] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f224771b-3e74-478f-8e84-a05495ab099b is going to be created. [ 649.322255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.322419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.322493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.322706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.322888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.341061] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: UNINITIALIZED for 2s [ 649.544476] env[66919]: INFO networking_nsxv3.common.synchronization [req-f8e5e114-80d4-41c4-bf9e-f4497b1c5e5b req-10ab51f8-f7e1-4283-9e1a-50e079b6ed72 tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 649.545102] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 649.545401] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4a6734-7330-47cc-9600-5eb1b1105162 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.545534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.545619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.545912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.546077] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4a6734-7330-47cc-9600-5eb1b1105162',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.666301] env[66919]: INFO networking_nsxv3.common.synchronization [None req-19c648d1-a1c1-43ff-9959-5f6e243dd1b2 None None] Enqueued Resource ID: 142a3f4f-4f7d-4071-9e95-6c3a91a2c066 with Priority: HIGHEST for action port [ 649.666414] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 142a3f4f-4f7d-4071-9e95-6c3a91a2c066 with Priority: HIGHEST for action port [ 649.667972] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-142a3f4f-4f7d-4071-9e95-6c3a91a2c066 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.667972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-142a3f4f-4f7d-4071-9e95-6c3a91a2c066" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.667972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-142a3f4f-4f7d-4071-9e95-6c3a91a2c066" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.667972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-142a3f4f-4f7d-4071-9e95-6c3a91a2c066" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.667972] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('142a3f4f-4f7d-4071-9e95-6c3a91a2c066',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.893649] env[66919]: INFO networking_nsxv3.common.synchronization [req-721ba1cb-aaef-43f2-901f-1b06e47ed9dd req-c5845f58-baa0-44a5-9ea0-5d228004d594 tempest-ImagesNegativeTestJSON-1534095671 tempest-ImagesNegativeTestJSON-1534095671-project-member] Enqueued Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 649.894223] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGHEST for action security_group_members [ 649.894529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.894662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.895938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.896213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.896698] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.896698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.896698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.897343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.897343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.897343] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.067948] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.068325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.068498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.068803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.069086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.069307] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4a6734-7330-47cc-9600-5eb1b1105162 already deleted. [ 650.069565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.171056] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 142a3f4f-4f7d-4071-9e95-6c3a91a2c066 [ 650.171056] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.171056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.171056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.171575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.171704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.171879] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:142a3f4f-4f7d-4071-9e95-6c3a91a2c066 already deleted. [ 650.172252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-142a3f4f-4f7d-4071-9e95-6c3a91a2c066" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.200098] env[66919]: INFO networking_nsxv3.common.synchronization [req-e716428c-d8c2-491f-9813-15ab1329b820 req-9f477865-9d17-446b-8a61-12cb6f2416ac tempest-ServerAddressesNegativeTestJSON-679100859 tempest-ServerAddressesNegativeTestJSON-679100859-project-member] Enqueued Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 650.200916] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 650.201355] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.201559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.201646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.202028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.202171] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.202306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.203312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.203598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.203714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.203868] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.399815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.400224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.400224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.400353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.400419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.400637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.400745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.400807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.400973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.401080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.401177] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 is going to be updated. [ 650.433264] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 650.433509] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 650.433697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.441401] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.441586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.441658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.441879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.442026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.453700] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: IN_PROGRESS for 2s [ 650.694343] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-983 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.694343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-983" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.694343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-983" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.694735] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-983" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.694811] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.697196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.697196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.697196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.697196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.697196] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.697196] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.697196] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.697196] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.697196] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 650.697196] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.697196] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.707833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.708025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.708097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.708547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.708680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.708929] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.708986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.709052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.709238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.709321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.709405] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 already deleted. [ 650.709520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.735494] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.738023] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 650.738023] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.738023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-983" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.738023] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-0dd4b199-5e60-492c-9e94-e6486812c86b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.738023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.738023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.738023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.738023] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd4b199-5e60-492c-9e94-e6486812c86b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.242544] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.242859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.243087] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.243530] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.243685] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.244054] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 0dd4b199-5e60-492c-9e94-e6486812c86b not found, creating... [ 651.244439] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.244812] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.244812] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.245031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.245211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.245581] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.245800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.245922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.246187] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246337] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.246541] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 0dd4b199-5e60-492c-9e94-e6486812c86b is going to be created. [ 651.273326] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.273831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.273831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.273990] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.274527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.274677] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.369178] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: SUCCESS [ 651.369506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.369598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.369808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.370043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.370195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.370291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.370509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.370622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.370705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.370793] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.874011] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.874011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.874011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.874431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.874431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.874431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.874431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.876101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.876101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.876101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.876101] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.011762] env[66919]: INFO networking_nsxv3.common.synchronization [req-e716428c-d8c2-491f-9813-15ab1329b820 req-bb73e148-2fe6-4bac-9873-1070307b374c service nova] Enqueued Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_rules [ 652.012866] env[66919]: INFO networking_nsxv3.common.synchronization [req-e716428c-d8c2-491f-9813-15ab1329b820 req-bb73e148-2fe6-4bac-9873-1070307b374c service nova] Enqueued Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 652.012866] env[66919]: INFO networking_nsxv3.common.synchronization [req-e716428c-d8c2-491f-9813-15ab1329b820 req-bb73e148-2fe6-4bac-9873-1070307b374c service nova] Enqueued Resource ID: 0dd4b199-5e60-492c-9e94-e6486812c86b with Priority: HIGHEST for action port [ 652.012866] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_rules [ 652.012866] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 652.012866] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd4b199-5e60-492c-9e94-e6486812c86b with Priority: HIGHEST for action port [ 652.013502] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.013604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.013677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.013935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.014028] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.014897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.014993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.015061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.015260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.015859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.015859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.015859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.015859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.015859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.015859] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.019086] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0dd4b199-5e60-492c-9e94-e6486812c86b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.019205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.019205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.019372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.019443] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0dd4b199-5e60-492c-9e94-e6486812c86b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.372336] env[66919]: INFO networking_nsxv3.common.synchronization [None req-56b3c958-cc85-4e7f-974b-9684c1eaf942 None None] Enqueued Resource ID: 079831d5-0753-4329-befe-f4c3f4ba0d07 with Priority: HIGHEST for action port [ 652.372336] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 079831d5-0753-4329-befe-f4c3f4ba0d07 with Priority: HIGHEST for action port [ 652.372336] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-079831d5-0753-4329-befe-f4c3f4ba0d07 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.372336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-079831d5-0753-4329-befe-f4c3f4ba0d07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.372336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-079831d5-0753-4329-befe-f4c3f4ba0d07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.372761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-079831d5-0753-4329-befe-f4c3f4ba0d07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.372761] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('079831d5-0753-4329-befe-f4c3f4ba0d07',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.378764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f224771b-3e74-478f-8e84-a05495ab099b: rpc.has_security_group_logging(os_id): False [ 652.407368] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.407537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.407620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.407899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.407973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.408251] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.408338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.408423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.408606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.408666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.408970] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.409072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.409126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.409715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.409715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.409715] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.409715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.409715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.410037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.410037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.410037] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f224771b-3e74-478f-8e84-a05495ab099b is going to be created. [ 652.443027] env[66919]: INFO networking_nsxv3.common.synchronization [req-879fc83e-9005-471e-9bc8-3dd007d6e8bd req-aab7dd53-5eda-48a4-944c-e6ae7467763b tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 652.443574] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 652.443961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.444718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.444718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.444718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.444718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.444994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.444994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.445198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.445759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.445759] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.464358] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 in Status: SUCCESS [ 652.464358] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 deletion is rescheduled due to dependency. [ 652.464358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.489257] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.491310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.491531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.491866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.492228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.514366] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: IN_PROGRESS for 2s [ 652.520552] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.521505] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.521690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.521855] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0dd4b199-5e60-492c-9e94-e6486812c86b with status ACTIVE [ 652.522283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.522443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.522508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.522750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.522855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.524376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.524571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.524661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.525009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.525009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.526829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.527505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.527505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.527505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.527505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.527505] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0dd4b199-5e60-492c-9e94-e6486812c86b is going to be updated. [ 652.596215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.596440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.596440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.596731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.596882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.597080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0dd4b199-5e60-492c-9e94-e6486812c86b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.867879] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.867879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.867879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.867879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.867879] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.868348] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.868589] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.869122] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.869575] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.869913] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.870220] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.872040] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.872040] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.872040] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.872040] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.872040] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.874934] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 079831d5-0753-4329-befe-f4c3f4ba0d07 [ 652.875239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.875239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.876353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.876353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.876353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.877112] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:079831d5-0753-4329-befe-f4c3f4ba0d07 already deleted. [ 652.877112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-079831d5-0753-4329-befe-f4c3f4ba0d07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.895861] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.896135] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.896276] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.896745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.898470] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-da611b91-106d-4c21-bd9f-d0d02598f03f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.898662] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.898764] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.899102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.899241] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da611b91-106d-4c21-bd9f-d0d02598f03f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.948557] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.948557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.948557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.948557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.948557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.948934] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.948934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.948934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.949132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.949132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.949132] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb already deleted. [ 652.949400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.030321] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.402146] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.402950] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.403243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.403944] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.404355] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.404622] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port da611b91-106d-4c21-bd9f-d0d02598f03f not found, creating... [ 653.405754] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.406094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.406243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410019] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.410019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.410019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: da611b91-106d-4c21-bd9f-d0d02598f03f is going to be created. [ 653.436224] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.436444] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.436652] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.437119] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.437361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.437740] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.476613] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fa82837e-c6a5-4bbb-a65b-3737e6c8ae5a None None] Enqueued Resource ID: 1da0af51-5bf7-4acd-8c4a-a2ff95c678f7 with Priority: HIGHEST for action port [ 653.476613] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1da0af51-5bf7-4acd-8c4a-a2ff95c678f7 with Priority: HIGHEST for action port [ 653.477227] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1da0af51-5bf7-4acd-8c4a-a2ff95c678f7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.477352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1da0af51-5bf7-4acd-8c4a-a2ff95c678f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.477435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1da0af51-5bf7-4acd-8c4a-a2ff95c678f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.477734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1da0af51-5bf7-4acd-8c4a-a2ff95c678f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.477859] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1da0af51-5bf7-4acd-8c4a-a2ff95c678f7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.532984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.533386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.533386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.533579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.533579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.533682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 is going to be created. [ 653.599253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.599441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.599495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.599687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.599845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.613968] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: UNINITIALIZED for 2s [ 653.980078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1da0af51-5bf7-4acd-8c4a-a2ff95c678f7 [ 653.981902] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.981902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.981902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.981902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.981902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.981902] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1da0af51-5bf7-4acd-8c4a-a2ff95c678f7 already deleted. [ 653.981902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1da0af51-5bf7-4acd-8c4a-a2ff95c678f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.331994] env[66919]: INFO networking_nsxv3.common.synchronization [req-879fc83e-9005-471e-9bc8-3dd007d6e8bd req-8b6fa973-73f3-4052-b3fc-c597ba575cef service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 654.331994] env[66919]: INFO networking_nsxv3.common.synchronization [req-879fc83e-9005-471e-9bc8-3dd007d6e8bd req-8b6fa973-73f3-4052-b3fc-c597ba575cef service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 654.332346] env[66919]: INFO networking_nsxv3.common.synchronization [req-879fc83e-9005-471e-9bc8-3dd007d6e8bd req-8b6fa973-73f3-4052-b3fc-c597ba575cef service nova] Enqueued Resource ID: da611b91-106d-4c21-bd9f-d0d02598f03f with Priority: HIGHEST for action port [ 654.332893] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 654.332976] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 654.336079] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da611b91-106d-4c21-bd9f-d0d02598f03f with Priority: HIGHEST for action port [ 654.336079] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.336079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.336253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.336440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.336605] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.338936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.338936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.338936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.338936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.338936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.339258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.339258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.339409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.339697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.339940] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.342247] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-da611b91-106d-4c21-bd9f-d0d02598f03f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.342368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.342496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.342693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.343062] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da611b91-106d-4c21-bd9f-d0d02598f03f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.533678] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: SUCCESS [ 654.535043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.847265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.847265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.847265] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.849472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port da611b91-106d-4c21-bd9f-d0d02598f03f with status ACTIVE [ 654.849472] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.850287] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.850471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.850622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.850808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.851238] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.851347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.851385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.851588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.851732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.851861] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: da611b91-106d-4c21-bd9f-d0d02598f03f is going to be updated. [ 654.864023] env[66919]: INFO networking_nsxv3.common.synchronization [req-61369652-0fab-46f3-9786-58fb45f8a24f req-ec7d16c5-552d-4bb2-9f72-044dbda8ba4a tempest-SecurityGroupRulesTestJSON-1163729001 tempest-SecurityGroupRulesTestJSON-1163729001-project-member] Enqueued Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 654.865632] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4a6734-7330-47cc-9600-5eb1b1105162 with Priority: HIGHEST for action security_group_rules [ 654.866607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac4a6734-7330-47cc-9600-5eb1b1105162 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.866821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.866951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.868023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.868023] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac4a6734-7330-47cc-9600-5eb1b1105162',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.897319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.897319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.897319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.897319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.897319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.897319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da611b91-106d-4c21-bd9f-d0d02598f03f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.361471] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.396020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.396020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.396020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.396020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.396020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.396020] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac4a6734-7330-47cc-9600-5eb1b1105162 already deleted. [ 655.396020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac4a6734-7330-47cc-9600-5eb1b1105162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.626983] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: SUCCESS [ 655.626983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.626983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.626983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.627264] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.627264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.627264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.627405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.627491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.627537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.627643] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.869225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.869225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.869225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.869225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.869225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.869225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be created. [ 655.912281] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.912533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.912533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.913877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.913877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.929329] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: UNINITIALIZED for 2s [ 656.130765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.132224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.132224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.132224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.132224] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.134166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.134316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.134572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.134814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.135175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.135430] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.135570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.135630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.135832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.136133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.136243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.136338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.136983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.137089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.137180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.137278] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.641404] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 872d14cf-31fb-44ed-a275-fe8a6bdf8512: rpc.has_security_group_logging(os_id): False [ 656.668405] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.668685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.668685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.668874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.668929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.669129] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.669271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.669316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.669436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.669512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.669680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.669820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.669820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.670185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.670185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.670316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.670316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.670429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.670563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.670563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.670703] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 is going to be created. [ 656.743679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.743827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.743923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.744234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.744474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.759181] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: IN_PROGRESS for 2s [ 656.775241] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c99651a5-fd7c-4f85-820c-78a2cb83824a None None] Enqueued Resource ID: 5789d477-5252-46f2-b967-6e9d7fe8039c with Priority: HIGHEST for action port [ 656.775241] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5789d477-5252-46f2-b967-6e9d7fe8039c with Priority: HIGHEST for action port [ 656.775241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5789d477-5252-46f2-b967-6e9d7fe8039c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.775241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5789d477-5252-46f2-b967-6e9d7fe8039c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.775241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5789d477-5252-46f2-b967-6e9d7fe8039c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.775241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5789d477-5252-46f2-b967-6e9d7fe8039c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.775241] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5789d477-5252-46f2-b967-6e9d7fe8039c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.278656] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5789d477-5252-46f2-b967-6e9d7fe8039c [ 657.278656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.278656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.278656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.278656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.278656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.278656] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5789d477-5252-46f2-b967-6e9d7fe8039c already deleted. [ 657.278656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5789d477-5252-46f2-b967-6e9d7fe8039c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.923666] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ebc8c537-9b47-4e79-9ee3-18e28933016f None None] Enqueued Resource ID: dbf46200-11c3-49b9-8d1e-55bbcd95c2ef with Priority: HIGHEST for action port [ 657.924640] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf46200-11c3-49b9-8d1e-55bbcd95c2ef with Priority: HIGHEST for action port [ 657.924970] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf46200-11c3-49b9-8d1e-55bbcd95c2ef taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.925730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf46200-11c3-49b9-8d1e-55bbcd95c2ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.925804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf46200-11c3-49b9-8d1e-55bbcd95c2ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.927090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf46200-11c3-49b9-8d1e-55bbcd95c2ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.927090] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf46200-11c3-49b9-8d1e-55bbcd95c2ef',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.946749] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 657.946749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.947082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.947548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.947761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.947882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.947946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.948161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.948280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.948659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.948659] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.430323] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbf46200-11c3-49b9-8d1e-55bbcd95c2ef [ 658.430935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.431554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.431554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.431554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.431678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.431890] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbf46200-11c3-49b9-8d1e-55bbcd95c2ef already deleted. [ 658.431975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf46200-11c3-49b9-8d1e-55bbcd95c2ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.457180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.457831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.457831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.457831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.457831] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.777681] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: SUCCESS [ 658.778914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.960746] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb: rpc.has_security_group_logging(os_id): False [ 658.985904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.986350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.986442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.986697] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.987477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.987477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.987477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.987738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.987738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.987885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.987946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.988135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.988226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.988279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.988421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.988494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.988579] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be created. [ 659.056118] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.056900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.057120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.057504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.057817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.073822] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 660.205924] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f946e4aa-0e52-4422-ac56-0b0b53ef083d None None] Enqueued Resource ID: ab2c7442-d753-4804-bd26-e76715259c92 with Priority: HIGHEST for action port [ 660.206261] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab2c7442-d753-4804-bd26-e76715259c92 with Priority: HIGHEST for action port [ 660.206545] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab2c7442-d753-4804-bd26-e76715259c92 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.210470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab2c7442-d753-4804-bd26-e76715259c92" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.210470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab2c7442-d753-4804-bd26-e76715259c92" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.210731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab2c7442-d753-4804-bd26-e76715259c92" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.210731] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab2c7442-d753-4804-bd26-e76715259c92',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.559188] env[66919]: INFO networking_nsxv3.common.synchronization [req-16418385-b43c-4f1c-b907-170eddf83c1b req-c7ffc4cc-2664-4f98-b6c6-135f2eab6454 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 660.559188] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 660.559188] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.559495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.559669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.559982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.560357] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.560661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.560979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.561389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.561592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.561793] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.717979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab2c7442-d753-4804-bd26-e76715259c92 [ 660.718455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.718455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.718455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.718658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.718740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.719712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab2c7442-d753-4804-bd26-e76715259c92 already deleted. [ 660.719712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab2c7442-d753-4804-bd26-e76715259c92" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.064064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.067150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.067299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.067623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.067742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.067983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.068188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.068262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.068458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.068551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.068643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 661.091355] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 661.091651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.114685] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.114685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.114685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.114685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.114685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.126789] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 661.264153] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.264153] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.264451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.264622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.264969] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.265178] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.265291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.265546] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.265704] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.265961] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.266095] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 661.266250] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 661.266919] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 661.266919] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 661.266919] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 661.266919] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.298694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.298914] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.299053] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.299268] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299587] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-b984f76c-5797-49da-943a-838826472c60 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299763] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.300279] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.300423] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b984f76c-5797-49da-943a-838826472c60',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.810782] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.811040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.811200] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.811504] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.811651] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.811806] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port b984f76c-5797-49da-943a-838826472c60 not found, creating... [ 661.812135] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.812300] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.812387] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.812600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.812732] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.813258] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.813258] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.813258] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.813459] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.813575] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.813707] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: b984f76c-5797-49da-943a-838826472c60 is going to be created. [ 661.837731] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.837965] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.838090] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.838359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.838573] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.838788] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.601920] env[66919]: INFO networking_nsxv3.common.synchronization [req-16418385-b43c-4f1c-b907-170eddf83c1b req-6fd55677-8da6-46b3-bb60-990957f7ffe5 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 662.601920] env[66919]: INFO networking_nsxv3.common.synchronization [req-16418385-b43c-4f1c-b907-170eddf83c1b req-6fd55677-8da6-46b3-bb60-990957f7ffe5 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 662.601920] env[66919]: INFO networking_nsxv3.common.synchronization [req-16418385-b43c-4f1c-b907-170eddf83c1b req-6fd55677-8da6-46b3-bb60-990957f7ffe5 service nova] Enqueued Resource ID: b984f76c-5797-49da-943a-838826472c60 with Priority: HIGHEST for action port [ 662.602752] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 662.604345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 662.604443] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b984f76c-5797-49da-943a-838826472c60 with Priority: HIGHEST for action port [ 662.604741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.605021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.605021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.605381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.605381] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.606190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.606328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.606539] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b984f76c-5797-49da-943a-838826472c60 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.606696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.606696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.606825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.606898] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b984f76c-5797-49da-943a-838826472c60',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.742472] env[66919]: INFO networking_nsxv3.common.synchronization [None req-00141714-b6b2-4a03-809a-9e1f141dc88f None None] Enqueued Resource ID: a42b6cec-83dc-4469-9b5f-78911d0466af with Priority: HIGHEST for action port [ 662.742696] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42b6cec-83dc-4469-9b5f-78911d0466af with Priority: HIGHEST for action port [ 662.743325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a42b6cec-83dc-4469-9b5f-78911d0466af taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.743325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a42b6cec-83dc-4469-9b5f-78911d0466af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.743450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a42b6cec-83dc-4469-9b5f-78911d0466af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.743648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a42b6cec-83dc-4469-9b5f-78911d0466af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.743722] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a42b6cec-83dc-4469-9b5f-78911d0466af',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.990866] env[66919]: INFO networking_nsxv3.common.synchronization [req-791acd36-a592-43e1-a925-7ec28509e7ff req-5d885392-e603-4d71-9084-03471b232867 tempest-FloatingIPsAssociationTestJSON-1688354250 tempest-FloatingIPsAssociationTestJSON-1688354250-project-member] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 662.991408] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 662.991545] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.992248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.992248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.992248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.992248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.992248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.992248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.992475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.992510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.992618] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.109296] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b984f76c-5797-49da-943a-838826472c60 with status ACTIVE [ 663.109520] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.109656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.109723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.109975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.110088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.110309] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.110429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.110485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.110703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.110813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.111052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.111190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.111278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.111480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.111601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.111717] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b984f76c-5797-49da-943a-838826472c60 is going to be updated. [ 663.113391] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.113391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.139840] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 663.141044] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 663.141044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.141044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.141044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.141044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.141044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.141044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.141395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.141395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.141395] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.145828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.145828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.145828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.145828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.145828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.145828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b984f76c-5797-49da-943a-838826472c60" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.250985] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a42b6cec-83dc-4469-9b5f-78911d0466af [ 663.253978] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.253978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.253978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.254225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.254225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.254313] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a42b6cec-83dc-4469-9b5f-78911d0466af already deleted. [ 663.254630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a42b6cec-83dc-4469-9b5f-78911d0466af" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.497848] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.645433] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.000696] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.147881] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.216775] env[66919]: INFO networking_nsxv3.common.synchronization [req-e69b4c96-97e1-41a5-90a5-54adf05fad88 req-afe24620-de8b-4789-9a62-02dc0fb82b75 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 664.217674] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 664.220611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.220611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.220611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.220611] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.503235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.506026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.506026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.506026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.506026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.506026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be updated. [ 664.539446] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.539603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.539675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.539896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.540049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.556409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 664.651338] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.652315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.652315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.652315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.652315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.652315] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 664.689767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.689767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.689972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.690273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.690573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.701551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 664.711614] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f5c472ee-fa4e-4898-a687-4ed94bc4d96a None None] Enqueued Resource ID: d636a115-f2ec-41a7-955e-205d7b933862 with Priority: HIGHEST for action port [ 664.711614] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d636a115-f2ec-41a7-955e-205d7b933862 with Priority: HIGHEST for action port [ 664.711614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d636a115-f2ec-41a7-955e-205d7b933862 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.711614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d636a115-f2ec-41a7-955e-205d7b933862" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.711614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d636a115-f2ec-41a7-955e-205d7b933862" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.711614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d636a115-f2ec-41a7-955e-205d7b933862" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.711614] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d636a115-f2ec-41a7-955e-205d7b933862',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.723971] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.724457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.724457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.724611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.724611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.724848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.724974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.725058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.725260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.725260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.725511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 already deleted. [ 664.725511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.791663] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.794329] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.794329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.794329] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.794329] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 664.794329] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 664.794329] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 664.795824] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 664.795824] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 664.795824] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 664.817722] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 664.817722] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 664.817722] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 664.817722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.817722] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-5786e07f-02f4-4c00-b2c8-ecc78738d32f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.817722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.817722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.818680] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.819019] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5786e07f-02f4-4c00-b2c8-ecc78738d32f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.213632] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d636a115-f2ec-41a7-955e-205d7b933862 [ 665.214106] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.214820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.214820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.214820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.214820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.215031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d636a115-f2ec-41a7-955e-205d7b933862 already deleted. [ 665.215281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d636a115-f2ec-41a7-955e-205d7b933862" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.321898] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.321898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.322176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.322429] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.322713] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.322713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 5786e07f-02f4-4c00-b2c8-ecc78738d32f not found, creating... [ 665.322902] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.323082] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.323195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.323419] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.323590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.323904] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.324073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.324182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.324476] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.324523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.324737] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 5786e07f-02f4-4c00-b2c8-ecc78738d32f is going to be created. [ 665.357413] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.357633] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.357777] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.358016] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.358246] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.358525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.090930] env[66919]: INFO networking_nsxv3.common.synchronization [req-e69b4c96-97e1-41a5-90a5-54adf05fad88 req-21a0ecf8-de13-4ba9-b1ea-301deb441c2b service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 666.091548] env[66919]: INFO networking_nsxv3.common.synchronization [req-e69b4c96-97e1-41a5-90a5-54adf05fad88 req-21a0ecf8-de13-4ba9-b1ea-301deb441c2b service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 666.091703] env[66919]: INFO networking_nsxv3.common.synchronization [req-e69b4c96-97e1-41a5-90a5-54adf05fad88 req-21a0ecf8-de13-4ba9-b1ea-301deb441c2b service nova] Enqueued Resource ID: 5786e07f-02f4-4c00-b2c8-ecc78738d32f with Priority: HIGHEST for action port [ 666.091945] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 666.092725] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 666.092725] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5786e07f-02f4-4c00-b2c8-ecc78738d32f with Priority: HIGHEST for action port [ 666.092725] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.093374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.093374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.094564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.094626] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.095781] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.101506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.101506] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.101506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5786e07f-02f4-4c00-b2c8-ecc78738d32f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.101506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.101506] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5786e07f-02f4-4c00-b2c8-ecc78738d32f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.248838] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5ecb1132-7768-46a9-8b41-3322d85b8688 None None] Enqueued Resource ID: eb6a89e6-acb1-44c7-8807-ba4a2a82cc12 with Priority: HIGHEST for action port [ 666.249413] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb6a89e6-acb1-44c7-8807-ba4a2a82cc12 with Priority: HIGHEST for action port [ 666.250053] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb6a89e6-acb1-44c7-8807-ba4a2a82cc12 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.250053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb6a89e6-acb1-44c7-8807-ba4a2a82cc12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.250053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb6a89e6-acb1-44c7-8807-ba4a2a82cc12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.251299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb6a89e6-acb1-44c7-8807-ba4a2a82cc12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.251299] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb6a89e6-acb1-44c7-8807-ba4a2a82cc12',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.567078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 666.567694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.603145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.603279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.604042] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.604429] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5786e07f-02f4-4c00-b2c8-ecc78738d32f with status ACTIVE [ 666.604663] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.604806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.604874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.605105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.605221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.605366] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.605461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.605519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.605769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.605769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.605931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.605994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.606211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.606378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.606488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.606535] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5786e07f-02f4-4c00-b2c8-ecc78738d32f is going to be updated. [ 666.642193] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.642380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.642427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.642616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.642751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.642915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5786e07f-02f4-4c00-b2c8-ecc78738d32f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.665409] env[66919]: INFO networking_nsxv3.common.synchronization [req-ec1feb7c-86c4-4656-bcf0-1e02b5cccd76 req-975d6a90-c263-457c-96ee-c201b621bb46 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 666.666027] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 666.666324] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.666911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.666911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.666911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.666911] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.667166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.667166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.667248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.667286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.667349] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.715197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 666.715446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.715631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.715893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.716085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.716214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.716289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.716467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.716550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.716638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.716788] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.755911] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eb6a89e6-acb1-44c7-8807-ba4a2a82cc12 [ 666.756059] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.756205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.756275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.756496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.756587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.756704] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eb6a89e6-acb1-44c7-8807-ba4a2a82cc12 already deleted. [ 666.756796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb6a89e6-acb1-44c7-8807-ba4a2a82cc12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.109601] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.144523] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.144523] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.144523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.145154] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.145189] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.145303] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.145396] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.145579] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.145720] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.145888] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.169790] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.179694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.180160] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.180940] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.180940] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.181772] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-42012fbd-83b4-463c-a822-086f96e691aa taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.182023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.182297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.182862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.183164] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42012fbd-83b4-463c-a822-086f96e691aa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.219194] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.219294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.220353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.220463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.220981] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.220981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.220981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.221301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.221301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.221301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.221903] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.221903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.221903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.221903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.222200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.222200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.222200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.223045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.223045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.223045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.223045] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.613782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.613972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.614052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.614885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.614885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.614885] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be created. [ 667.641099] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.641281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.641328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.641664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.641762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.652857] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: UNINITIALIZED for 2s [ 667.672860] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.822166] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.822166] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.822166] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.822414] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.822569] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.822754] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 42012fbd-83b4-463c-a822-086f96e691aa not found, creating... [ 667.823015] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.823164] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.823267] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.823508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.823796] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.823857] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.824029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.824151] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.824343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.824469] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.824608] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 42012fbd-83b4-463c-a822-086f96e691aa is going to be created. [ 667.825996] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5: rpc.has_security_group_logging(os_id): False [ 667.848275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.848445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.848492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.848699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.848788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.848983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.849124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.849187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.849343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.849416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.849602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.849695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.849756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.849896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.849968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.850181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.850271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.850329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.850465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.850536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.850616] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 667.863184] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.863454] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.863590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.863745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.863961] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.864194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.930382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.930382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.930382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.930382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.930725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.950950] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 668.328610] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.328959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.329014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.329295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.329404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.329518] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 668.390880] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.390880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.390880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.391198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.391359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.402669] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 668.465675] env[66919]: INFO networking_nsxv3.common.synchronization [req-ec1feb7c-86c4-4656-bcf0-1e02b5cccd76 req-ce36abcc-0f10-40bc-98dd-939a71295b31 service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 668.465675] env[66919]: INFO networking_nsxv3.common.synchronization [req-ec1feb7c-86c4-4656-bcf0-1e02b5cccd76 req-ce36abcc-0f10-40bc-98dd-939a71295b31 service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 668.465675] env[66919]: INFO networking_nsxv3.common.synchronization [req-ec1feb7c-86c4-4656-bcf0-1e02b5cccd76 req-ce36abcc-0f10-40bc-98dd-939a71295b31 service nova] Enqueued Resource ID: 42012fbd-83b4-463c-a822-086f96e691aa with Priority: HIGHEST for action port [ 668.466172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 668.466305] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 668.466416] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42012fbd-83b4-463c-a822-086f96e691aa with Priority: HIGHEST for action port [ 668.466721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.466845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.466926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.467298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.467421] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.468482] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.468541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.469022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-42012fbd-83b4-463c-a822-086f96e691aa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.471482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.471482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.471482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.471482] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42012fbd-83b4-463c-a822-086f96e691aa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.630325] env[66919]: INFO networking_nsxv3.common.synchronization [req-10f8cb67-8c5d-48f5-876f-426ee58a4e22 req-56f644d9-bc5a-4436-8802-8bee3b7ea1a0 tempest-ServersNegativeTestJSON-918520820 tempest-ServersNegativeTestJSON-918520820-project-member] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 668.631866] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 668.631866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.631866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.631866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.632056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.632203] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.632325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.632421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.632622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.632743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.632856] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.974167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.974167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.974167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42012fbd-83b4-463c-a822-086f96e691aa with status ACTIVE [ 668.974167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.974167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.974167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.974831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.975331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.975633] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.975796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.976883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.976883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.976883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.976883] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.976883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.976883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.977165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.977210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.977342] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42012fbd-83b4-463c-a822-086f96e691aa is going to be updated. [ 669.004045] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.004045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.004045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.004045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.004045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.004045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42012fbd-83b4-463c-a822-086f96e691aa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.100789] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.101298] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.101298] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.102331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.102331] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.102331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.102331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.104037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.104037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.104037] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.104037] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.104037] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.104037] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.104037] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.104037] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.104392] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.135795] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.140280] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.140280] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.140280] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.143404] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.144010] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-33415465-26f3-490e-abe3-165a78f0c630 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.144351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.144351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.144729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.144909] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33415465-26f3-490e-abe3-165a78f0c630',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.647356] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.655086] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.656024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.656024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.656321] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.656488] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.657353] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 33415465-26f3-490e-abe3-165a78f0c630 not found, creating... [ 669.657353] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.657353] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.657353] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.657609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.657609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.657820] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.657999] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.658140] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.658382] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.658511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.658644] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 33415465-26f3-490e-abe3-165a78f0c630 is going to be created. [ 669.668866] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 669.669162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.669261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.669756] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.669756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.669966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.669966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.670487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.670487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.670487] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.680809] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.680943] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.681111] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.681373] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.681605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.681851] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.854536] env[66919]: INFO networking_nsxv3.common.synchronization [None req-06acbd08-27f7-4861-ab5c-dee130410553 None None] Enqueued Resource ID: 5e63799a-ca7e-4489-95c7-176c5b0ea0f6 with Priority: HIGHEST for action port [ 669.855124] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e63799a-ca7e-4489-95c7-176c5b0ea0f6 with Priority: HIGHEST for action port [ 669.855426] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e63799a-ca7e-4489-95c7-176c5b0ea0f6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.855544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e63799a-ca7e-4489-95c7-176c5b0ea0f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.856014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e63799a-ca7e-4489-95c7-176c5b0ea0f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.856014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e63799a-ca7e-4489-95c7-176c5b0ea0f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.856014] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e63799a-ca7e-4489-95c7-176c5b0ea0f6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.989398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 669.989398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.151037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.151037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.151037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.151037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.151360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.151360] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 670.176027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.176027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.176027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.176027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.177283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.177460] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.177565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.180208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.180459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.180759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.180759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.180844] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.191094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.191476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.191476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.191700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.191893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.206425] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 670.359137] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e63799a-ca7e-4489-95c7-176c5b0ea0f6 [ 670.359436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.359603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.359676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.359896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.360046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.360283] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e63799a-ca7e-4489-95c7-176c5b0ea0f6 already deleted. [ 670.360283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e63799a-ca7e-4489-95c7-176c5b0ea0f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.413648] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 670.413898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.414108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.414346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.414535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.414817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.414817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.414921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.414983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.415931] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [req-10f8cb67-8c5d-48f5-876f-426ee58a4e22 req-7a285824-69c4-406a-be61-9722c8e9e363 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [req-10f8cb67-8c5d-48f5-876f-426ee58a4e22 req-7a285824-69c4-406a-be61-9722c8e9e363 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [req-10f8cb67-8c5d-48f5-876f-426ee58a4e22 req-7a285824-69c4-406a-be61-9722c8e9e363 service nova] Enqueued Resource ID: 33415465-26f3-490e-abe3-165a78f0c630 with Priority: HIGHEST for action port [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 670.501383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33415465-26f3-490e-abe3-165a78f0c630 with Priority: HIGHEST for action port [ 670.503189] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.503638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.503934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.504316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.504544] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.507595] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.507731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.507891] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-33415465-26f3-490e-abe3-165a78f0c630 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.508038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.508110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.508299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.508378] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33415465-26f3-490e-abe3-165a78f0c630',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.683337] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 670.710462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.710653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.710706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.711563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.711563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.711563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.711563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.711563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.711903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.711903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.711975] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.713533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.713659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.713818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.713921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.714171] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.714273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.714350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.714512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.714597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.714759] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be created. [ 670.830818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.831099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.831241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.831591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.831829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.854842] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 670.918609] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.014904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.014904] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33415465-26f3-490e-abe3-165a78f0c630 with status ACTIVE [ 671.014904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.014904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.014904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.014904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.015558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.015558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.015558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.015558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.015558] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33415465-26f3-490e-abe3-165a78f0c630 is going to be updated. [ 671.038812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.038812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.039928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.039928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.039928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.039928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33415465-26f3-490e-abe3-165a78f0c630" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.099162] env[66919]: INFO networking_nsxv3.common.synchronization [req-bebddbec-07d1-4e40-80b1-c1e3a685c51c req-6fcc2ae7-76de-4bd2-b3aa-e7c6bf58fc17 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 671.099870] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 671.100670] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.100823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.100910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.101218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.101382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.101525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.101636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.101804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.102229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.102229] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.422484] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.605453] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.605635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.605635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.605866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.605969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.606185] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.606287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.606580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.606862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.606977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.607034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b already deleted. [ 671.607116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.652186] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5354275a-3fd7-46c3-ac3d-3626cfd0f508 None None] Enqueued Resource ID: 7accf1c6-cdfb-435b-b48a-5c980a360278 with Priority: HIGHEST for action port [ 671.652792] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7accf1c6-cdfb-435b-b48a-5c980a360278 with Priority: HIGHEST for action port [ 671.653797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7accf1c6-cdfb-435b-b48a-5c980a360278 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.653995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7accf1c6-cdfb-435b-b48a-5c980a360278" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.654436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7accf1c6-cdfb-435b-b48a-5c980a360278" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.654854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7accf1c6-cdfb-435b-b48a-5c980a360278" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.655255] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7accf1c6-cdfb-435b-b48a-5c980a360278',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.660202] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.660395] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.660513] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.660898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.661189] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.661353] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.661513] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.661673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.661819] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.662043] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.662160] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.662286] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.662407] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.662540] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 671.662662] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.662797] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.690026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.690026] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 671.690026] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.690026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.690026] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-87926929-82f8-48d3-8129-f23b7d1d5916 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.690026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.690026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.690026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.690026] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87926929-82f8-48d3-8129-f23b7d1d5916',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.927579] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.927579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.927579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.927579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.927579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.927579] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 671.959216] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.959644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.959644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.959936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.961025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.976355] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 672.159267] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7accf1c6-cdfb-435b-b48a-5c980a360278 [ 672.159552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.159707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.159802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.160043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.160145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.160244] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7accf1c6-cdfb-435b-b48a-5c980a360278 already deleted. [ 672.160352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7accf1c6-cdfb-435b-b48a-5c980a360278" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.193530] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.194283] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.194283] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.194283] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.194470] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.194594] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 87926929-82f8-48d3-8129-f23b7d1d5916 not found, creating... [ 672.194945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.195132] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.195246] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.195485] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.195618] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.197050] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.197303] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.197502] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.197860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.198096] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.198331] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 87926929-82f8-48d3-8129-f23b7d1d5916 is going to be created. [ 672.217282] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 4s [ 672.228735] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.228895] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.229407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.229407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.232420] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.232420] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.796653] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8eb0fff-34df-4f5f-91ee-aad9e5f4473d req-943bcc39-eb80-40ef-9cbd-020d4e7eadf2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 672.798025] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 672.798545] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.798787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.798787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.799130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.799250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.799355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.799429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.799556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.799644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.799738] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8eb0fff-34df-4f5f-91ee-aad9e5f4473d req-943bcc39-eb80-40ef-9cbd-020d4e7eadf2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8eb0fff-34df-4f5f-91ee-aad9e5f4473d req-943bcc39-eb80-40ef-9cbd-020d4e7eadf2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8eb0fff-34df-4f5f-91ee-aad9e5f4473d req-943bcc39-eb80-40ef-9cbd-020d4e7eadf2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 672.836053] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 672.836053] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.836053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.836053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.836053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.836053] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.836878] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.836878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.837048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-788267e3-6cc6-42fe-9400-2c8bac8bfd28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.837176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.837254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.837498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.837594] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788267e3-6cc6-42fe-9400-2c8bac8bfd28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.873053] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 672.873283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [req-bebddbec-07d1-4e40-80b1-c1e3a685c51c req-b57d2d52-7c1d-4c3d-85ef-bcc26e0f72e6 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [req-bebddbec-07d1-4e40-80b1-c1e3a685c51c req-b57d2d52-7c1d-4c3d-85ef-bcc26e0f72e6 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [req-bebddbec-07d1-4e40-80b1-c1e3a685c51c req-b57d2d52-7c1d-4c3d-85ef-bcc26e0f72e6 service nova] Enqueued Resource ID: 87926929-82f8-48d3-8129-f23b7d1d5916 with Priority: HIGHEST for action port [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 673.015212] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87926929-82f8-48d3-8129-f23b7d1d5916 with Priority: HIGHEST for action port [ 673.016197] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.017576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.017576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.020475] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.020475] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.020475] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.020475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.020475] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.021932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-87926929-82f8-48d3-8129-f23b7d1d5916 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.022108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.022108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.022272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.022405] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87926929-82f8-48d3-8129-f23b7d1d5916',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.304527] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.346228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.346228] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with status ACTIVE [ 673.346228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.346228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.346228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.346228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.346797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.346797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.346797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.346797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.346797] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 is going to be updated. [ 673.398401] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.398667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.398667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.400588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.400588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.400588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.525657] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.526288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.526288] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.527791] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87926929-82f8-48d3-8129-f23b7d1d5916 with status ACTIVE [ 673.528184] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.528416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.531067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.531067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.531067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.531067] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87926929-82f8-48d3-8129-f23b7d1d5916 is going to be updated. [ 673.578909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.580184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.580184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.580184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.580184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.580184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87926929-82f8-48d3-8129-f23b7d1d5916" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.807971] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.989748] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 673.989748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.989748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.989748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.989921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.990019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.990087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.991037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.991037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.991037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.991037] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.032740] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.233591] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 674.234019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.234246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.234485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.234889] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.237320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.237411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.237643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.237764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.237897] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.311357] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.311569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.311569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.312117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.312117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.312117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 674.348066] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.348246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.348321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.348663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.348845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.360312] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 674.498961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.498961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.498961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.498961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.499738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.499738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.499738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.503096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.503313] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.538023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.538023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.538023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.538023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.538023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.538023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be created. [ 674.550222] env[66919]: INFO networking_nsxv3.common.synchronization [None req-43589e50-97c6-4641-9769-ba964d6df975 None None] Enqueued Resource ID: d6e00b6f-ba4c-4895-99d1-7d171dd77081 with Priority: HIGHEST for action port [ 674.550222] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6e00b6f-ba4c-4895-99d1-7d171dd77081 with Priority: HIGHEST for action port [ 674.550469] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6e00b6f-ba4c-4895-99d1-7d171dd77081 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.550626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6e00b6f-ba4c-4895-99d1-7d171dd77081" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.550757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6e00b6f-ba4c-4895-99d1-7d171dd77081" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.550977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6e00b6f-ba4c-4895-99d1-7d171dd77081" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.551108] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6e00b6f-ba4c-4895-99d1-7d171dd77081',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.563207] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.563386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.563440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.563619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.563778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.575403] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: UNINITIALIZED for 2s [ 674.740686] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.007025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb: rpc.has_security_group_logging(os_id): False [ 675.029972] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.030167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.030241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.030470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.031015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.031015] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.031015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.031015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.031426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.031510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.031769] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.031934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.031934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.032113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.032224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.032959] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.032959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.032959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.033239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.033691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.033691] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 675.052853] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6e00b6f-ba4c-4895-99d1-7d171dd77081 [ 675.053112] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.053285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.053694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.053694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.053694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.053911] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6e00b6f-ba4c-4895-99d1-7d171dd77081 already deleted. [ 675.053911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6e00b6f-ba4c-4895-99d1-7d171dd77081" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.141753] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.141969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.141969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.142222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.142374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.160367] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 675.244074] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.746639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.746639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.746639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.746639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.747384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.747384] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 675.811468] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.811713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.811798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.812110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.812334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.838243] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 676.389222] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 676.389639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.389639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.389805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.390024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.390197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.390305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.390512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.390618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.390731] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.587727] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 676.588052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.588178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.588445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.588802] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.588802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.588802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.589132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.589132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.589233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.589379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.894242] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.091742] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.091901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.091974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.092520] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.092637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.092743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.092916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.093070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.093175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.093367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.093464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.093524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.093664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.093800] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.093891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.093951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.094099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.094175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.094304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.094398] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.180482] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 677.183044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.396126] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.596525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 677.620478] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.620683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.620727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.621052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.621232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.621484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.621709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.621709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.621873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.621985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.622531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.622867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.622867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.622982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.623076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.623391] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.623648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.623747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.623927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.624094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.624265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be created. [ 677.695382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.695544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.695612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.695827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.696055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.708967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 677.851574] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 677.851884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.852151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.852333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.852524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.852651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.852763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.852969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.852969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.853088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.853088] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.903900] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.904128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.904128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.904398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.904493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.904612] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 677.935524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.935707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.935807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.936119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.936308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.946971] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 678.356101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.356334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.356448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.356766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.356962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.357085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.357148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.357323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.357458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.357564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.357743] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.357832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.357893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.358097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.358269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.358384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.358448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.358626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.358706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.358787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.358877] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.864426] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54a8eb66-4aa1-440c-af86-e5e65121f69f: rpc.has_security_group_logging(os_id): False [ 678.892219] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.892420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.892513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.892756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.892904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.893148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.893260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.893371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.893533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.893635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.893859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.894103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.894103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.894276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.894381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.894711] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.894855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.894907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.895244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.895244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.895392] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 678.974814] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.975023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.975083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.975342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.975520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.996929] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 679.551585] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 679.551585] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 679.699033] env[66919]: INFO networking_nsxv3.common.synchronization [req-a74bb24e-1579-4ac9-95b9-c7e115574f11 req-4aee14cd-26a0-45b7-8c05-9e4fe5c70320 tempest-ServerExternalEventsTest-1526113989 tempest-ServerExternalEventsTest-1526113989-project-member] Enqueued Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 679.700040] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGHEST for action security_group_members [ 679.700040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.700343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.700343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.700892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.700892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.700892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.700892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.701240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.701240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.701575] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.726837] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 679.727171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.962459] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 679.962825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.962886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.963648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.963648] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.963648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.963648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.964555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.964555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.964719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.964719] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.204936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.204936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.205191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.205455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.206398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.206398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.206398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.206398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.206646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.206696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.207251] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f224771b-3e74-478f-8e84-a05495ab099b is going to be updated. [ 680.246436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.246632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.246632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.246879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.247073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.258170] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: IN_PROGRESS for 2s [ 680.264251] env[66919]: INFO networking_nsxv3.common.synchronization [req-3ab577c6-2b28-4228-a68d-15446c898c48 req-71e7a684-73ee-4e9b-a939-4cd7e520d8f2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 680.264556] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 680.266094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.266094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.266094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.266094] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.288093] env[66919]: INFO networking_nsxv3.common.synchronization [req-3ab577c6-2b28-4228-a68d-15446c898c48 req-71e7a684-73ee-4e9b-a939-4cd7e520d8f2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 680.288338] env[66919]: INFO networking_nsxv3.common.synchronization [req-3ab577c6-2b28-4228-a68d-15446c898c48 req-71e7a684-73ee-4e9b-a939-4cd7e520d8f2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 680.288514] env[66919]: INFO networking_nsxv3.common.synchronization [req-3ab577c6-2b28-4228-a68d-15446c898c48 req-71e7a684-73ee-4e9b-a939-4cd7e520d8f2 tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 680.289575] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_rules [ 680.289764] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 680.289875] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with Priority: HIGHEST for action port [ 680.290247] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.290668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.290668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.290668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.291071] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-788267e3-6cc6-42fe-9400-2c8bac8bfd28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.291071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.291071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.291305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.291393] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('788267e3-6cc6-42fe-9400-2c8bac8bfd28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.469350] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.769240] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.771177] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c767865-f083-41fa-93e7-0c0a3bc82518 req-75f81866-7f7b-401f-bb2a-c963141bb122 tempest-ServerMetadataTestJSON-1609507993 tempest-ServerMetadataTestJSON-1609507993-project-member] Enqueued Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 680.771983] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGHEST for action security_group_members [ 680.772391] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.772559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.772625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.772908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.773614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.774273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.774273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.774273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.774273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.774273] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.793781] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 788267e3-6cc6-42fe-9400-2c8bac8bfd28 with status ACTIVE [ 680.794074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.794198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.794279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.794485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.794591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.795117] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.795281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.795355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.795533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.795618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.795841] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.795958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.796035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.796216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.796315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.796425] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 788267e3-6cc6-42fe-9400-2c8bac8bfd28 is going to be updated. [ 680.825585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.825736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.825782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.826013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.826178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.826543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-788267e3-6cc6-42fe-9400-2c8bac8bfd28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.972377] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11de85e1-8fdb-4cd8-898c-db27313f960d: rpc.has_security_group_logging(os_id): False [ 680.992785] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.992955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.993037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.993251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.993348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.993602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.993700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.993754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.993902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.993976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.994075] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 681.011165] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 681.011414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.061685] env[66919]: INFO networking_nsxv3.common.synchronization [req-babe7789-7ae2-4bc5-822c-312030bd6121 req-ecb8cca3-fa64-465f-87e3-dd0a32a5a455 tempest-ServerAddressesNegativeTestJSON-679100859 tempest-ServerAddressesNegativeTestJSON-679100859-project-member] Enqueued Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 681.063258] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.063454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.063517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.063821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.064068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.066795] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGHEST for action security_group_members [ 681.068419] env[66919]: INFO networking_nsxv3.common.synchronization [req-ff125c51-7a42-4217-abba-4fe53ddd3d35 req-cebd61bd-55e8-4c4d-8282-ee52651eab45 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 681.068768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.068890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.068958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.069189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.069343] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.069439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.069499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.069645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.069726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.069816] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.071771] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 681.072087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.072200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.072265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.072473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.072703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.072803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.072861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.073141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.073245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.073338] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.112215] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 681.272836] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.276445] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.276589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.276786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.276898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.277008] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.277219] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.277330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.277392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.277550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.277624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.277708] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd is going to be updated. [ 681.317722] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.318016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.318016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.318250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.318404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.330787] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: IN_PROGRESS for 2s [ 681.483708] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f784732-e279-4b96-98b0-d56bce054235 req-202db1de-9f30-4b07-a314-6df1dbb1d5f2 tempest-FloatingIPsAssociationNegativeTestJSON-1499238197 tempest-FloatingIPsAssociationNegativeTestJSON-1499238197-project-member] Enqueued Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 681.484030] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 681.486142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.486142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.486142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.486142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.486142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.486142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.486142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.486417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.486417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.486555] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.571603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.572168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.572168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.572168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.572312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.575510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.575510] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 is going to be updated. [ 681.575510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.575510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.576043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.576043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.576043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.576043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.576255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.576369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.576460] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 681.612261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.614098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.614098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.614098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.614098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.614945] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.615095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.615160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.615347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.615471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.628126] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 681.628126] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: IN_PROGRESS for 2s [ 681.779411] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.779411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.779411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.779411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.779411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.779411] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 681.817169] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.817169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.817169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.817169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.817169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.826939] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 681.989414] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.991270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.991270] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa already deleted. [ 681.991270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.271967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f224771b-3e74-478f-8e84-a05495ab099b in Status: SUCCESS [ 682.272164] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f224771b-3e74-478f-8e84-a05495ab099b deletion is rescheduled due to dependency. [ 682.272381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.350524] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-690 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.350524] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-690" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.350524] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-690" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.350960] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-690" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.351660] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.351660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.351660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.351863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.351863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.352158] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.352305] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.352367] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.352474] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.352782] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.352782] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.354731] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.378736] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.379967] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.379967] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.379967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-690" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.379967] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-d00aadff-8453-48f5-b0ce-01f05acf5315 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.379967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.379967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.380480] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.380480] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00aadff-8453-48f5-b0ce-01f05acf5315',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.886032] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.886614] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.886916] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.887323] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.887602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.887882] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port d00aadff-8453-48f5-b0ce-01f05acf5315 not found, creating... [ 682.888308] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.888644] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.888854] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.889246] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.890128] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.890822] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.891444] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.891674] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.892052] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.892295] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.892653] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: d00aadff-8453-48f5-b0ce-01f05acf5315 is going to be created. [ 682.917630] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.917630] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.919040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.919040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.919040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.919040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.108510] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 683.108510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.108510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.108510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.108510] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.343853] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af39d9f2-2893-4829-94fc-ff7334ea19fd in Status: SUCCESS [ 683.344154] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd deletion is rescheduled due to dependency. [ 683.344230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.615817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.616012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.640646] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 in Status: SUCCESS [ 683.644823] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 deletion is rescheduled due to dependency. [ 683.644895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.645979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 683.648282] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 683.648454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.689731] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f784732-e279-4b96-98b0-d56bce054235 req-b0bfd621-a635-4967-8558-c8f76f2a299d service nova] Enqueued Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_rules [ 683.689940] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f784732-e279-4b96-98b0-d56bce054235 req-b0bfd621-a635-4967-8558-c8f76f2a299d service nova] Enqueued Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 683.690123] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f784732-e279-4b96-98b0-d56bce054235 req-b0bfd621-a635-4967-8558-c8f76f2a299d service nova] Enqueued Resource ID: d00aadff-8453-48f5-b0ce-01f05acf5315 with Priority: HIGHEST for action port [ 683.690680] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_rules [ 683.693389] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 683.693530] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d00aadff-8453-48f5-b0ce-01f05acf5315 with Priority: HIGHEST for action port [ 683.693842] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.693970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.694083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.694319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.696024] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.696024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.696024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.696024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.696024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.696242] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.696242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.696300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.696402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.696507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.696604] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.701862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d00aadff-8453-48f5-b0ce-01f05acf5315 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.701982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.702058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.702242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.702318] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d00aadff-8453-48f5-b0ce-01f05acf5315',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.839723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 683.839986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.840193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.840494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.840691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.840831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.840895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.841140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.841267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.841432] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.209046] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.209046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.209046] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.209818] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d00aadff-8453-48f5-b0ce-01f05acf5315 with status ACTIVE [ 684.209818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.209818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.209818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.210081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.210081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.211761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.211761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.211761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.212438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.212438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.212438] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d00aadff-8453-48f5-b0ce-01f05acf5315 is going to be updated. [ 684.238538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.238762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.238762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.238976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.239191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.239415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d00aadff-8453-48f5-b0ce-01f05acf5315" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.343772] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.714437] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.847022] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.219208] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.219598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.219702] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.219920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.220075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.220139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa is going to be created. [ 685.247521] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.247741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.247741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.248044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.248128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.259760] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: UNINITIALIZED for 2s [ 685.349636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.349820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.349880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.350107] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.350204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.350304] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 685.379779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.379934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.379934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.380155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.380292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.388918] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 685.599712] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d0457aad-497d-47e2-94e5-f8b028b745fc None None] Enqueued Resource ID: abca3f77-bc31-44d7-bc09-c2dca8a56b1c with Priority: HIGHEST for action port [ 685.600328] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abca3f77-bc31-44d7-bc09-c2dca8a56b1c with Priority: HIGHEST for action port [ 685.600686] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-abca3f77-bc31-44d7-bc09-c2dca8a56b1c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.600810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abca3f77-bc31-44d7-bc09-c2dca8a56b1c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.600879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abca3f77-bc31-44d7-bc09-c2dca8a56b1c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.601644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abca3f77-bc31-44d7-bc09-c2dca8a56b1c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.602013] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abca3f77-bc31-44d7-bc09-c2dca8a56b1c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.991988] env[66919]: INFO networking_nsxv3.common.synchronization [None req-467d7824-af9c-4bd9-803a-cb8391137184 None None] Enqueued Resource ID: b1dd37f6-0558-4277-8c17-4d27f95dcaa8 with Priority: HIGHEST for action port [ 685.991988] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dd37f6-0558-4277-8c17-4d27f95dcaa8 with Priority: HIGHEST for action port [ 685.991988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1dd37f6-0558-4277-8c17-4d27f95dcaa8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1dd37f6-0558-4277-8c17-4d27f95dcaa8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1dd37f6-0558-4277-8c17-4d27f95dcaa8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1dd37f6-0558-4277-8c17-4d27f95dcaa8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992984] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1dd37f6-0558-4277-8c17-4d27f95dcaa8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.110752] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abca3f77-bc31-44d7-bc09-c2dca8a56b1c [ 686.110752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.110752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.110752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.110752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.110752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.110752] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abca3f77-bc31-44d7-bc09-c2dca8a56b1c already deleted. [ 686.110752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abca3f77-bc31-44d7-bc09-c2dca8a56b1c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.497039] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b1dd37f6-0558-4277-8c17-4d27f95dcaa8 [ 686.497357] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.497357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.497357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.497565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.497656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.497753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b1dd37f6-0558-4277-8c17-4d27f95dcaa8 already deleted. [ 686.497835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1dd37f6-0558-4277-8c17-4d27f95dcaa8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.645293] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6ae9470-9886-4ba3-8ca9-956229fcdbe3 req-9e70261f-3c8a-48a3-8676-810e2e67e32c tempest-ServerRescueTestJSON-397859255 tempest-ServerRescueTestJSON-397859255-project-member] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 686.646170] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 686.646333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.646483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.650123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.650427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.650612] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.650723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.650789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.650951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.651055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.651152] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.154745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.154918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.155025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.155261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.155372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.155758] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.155758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.155758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.155908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.156011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.156101] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd already deleted. [ 687.156182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.221810] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.222083] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.222336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.222958] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.223147] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.225133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.225133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.225133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.225133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.225133] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.225133] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 687.225133] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 687.225133] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 687.225133] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 687.225133] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 687.225454] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 687.247123] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 687.247286] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 687.247421] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 687.247589] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.247916] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-0f99b3f4-2618-4b49-a022-73e345a53ca5 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.248114] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.248258] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.248620] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.248874] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f99b3f4-2618-4b49-a022-73e345a53ca5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.269585] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: SUCCESS [ 687.270336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.270460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.270667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.270855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.271062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.271062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.271192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.271305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.271438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.271482] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.399331] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 687.399614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.399833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.400116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.400347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.400510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.400615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.400821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.400964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.401141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.401299] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.447992] env[66919]: INFO networking_nsxv3.common.synchronization [None req-7a4edd57-0b7d-4e12-8f1a-a691885e6309 tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 05638494-e671-458f-8ab1-1668cd6d3d7b with Priority: HIGHEST for action security_group_rules [ 687.447992] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05638494-e671-458f-8ab1-1668cd6d3d7b with Priority: HIGHEST for action security_group_rules [ 687.448249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05638494-e671-458f-8ab1-1668cd6d3d7b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.448601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.448601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.449042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.449042] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05638494-e671-458f-8ab1-1668cd6d3d7b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.590468] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f4e14576-c01e-4ef0-b158-708720aec607 tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 05638494-e671-458f-8ab1-1668cd6d3d7b with Priority: HIGHEST for action security_group_rules [ 687.594675] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05638494-e671-458f-8ab1-1668cd6d3d7b with Priority: HIGHEST for action security_group_rules [ 687.594843] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05638494-e671-458f-8ab1-1668cd6d3d7b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.595010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.751791] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.752139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.752322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.752841] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.752981] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.753197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 0f99b3f4-2618-4b49-a022-73e345a53ca5 not found, creating... [ 687.753600] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.754328] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.756246] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.756657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.756844] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.757440] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.757736] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.757851] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.758418] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.758602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.758840] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 0f99b3f4-2618-4b49-a022-73e345a53ca5 is going to be created. [ 687.775253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.775253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.775253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.775253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.775679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.775679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.775679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.775679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.775782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.775859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.775961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.776061] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.783827] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.785313] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.785313] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.785313] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.785676] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.786964] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.904614] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.979657] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.979657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.979657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.979862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.979862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.980455] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05638494-e671-458f-8ab1-1668cd6d3d7b already deleted. [ 687.980455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.980455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.980604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.980634] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05638494-e671-458f-8ab1-1668cd6d3d7b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.255914] env[66919]: INFO networking_nsxv3.common.synchronization [None req-826cac6d-acba-4766-aee5-c02cf54b0fa1 None None] Enqueued Resource ID: 08ca3a55-006b-4d39-b149-85d24da1bce8 with Priority: HIGHEST for action port [ 688.256767] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ca3a55-006b-4d39-b149-85d24da1bce8 with Priority: HIGHEST for action port [ 688.257605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ca3a55-006b-4d39-b149-85d24da1bce8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.257782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ca3a55-006b-4d39-b149-85d24da1bce8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.257885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ca3a55-006b-4d39-b149-85d24da1bce8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.258460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ca3a55-006b-4d39-b149-85d24da1bce8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.258600] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ca3a55-006b-4d39-b149-85d24da1bce8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.280233] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25ae71be-f061-446d-96fb-cc2053e285fa: rpc.has_security_group_logging(os_id): False [ 688.302718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.302804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.303704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.303704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.303704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.303704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.303704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.303704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.304430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.306063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.306063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.306063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.306063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.306063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.306063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.306318] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.306414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.306480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.306638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.307292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.307292] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa is going to be created. [ 688.379248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.381360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.381360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.381360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.381360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.392655] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: IN_PROGRESS for 2s [ 688.408665] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11de85e1-8fdb-4cd8-898c-db27313f960d: rpc.has_security_group_logging(os_id): False [ 688.438023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.438023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.438023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.438023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 688.512721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.512862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.512947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.516525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.516525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.516525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05638494-e671-458f-8ab1-1668cd6d3d7b already deleted. [ 688.516525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05638494-e671-458f-8ab1-1668cd6d3d7b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.548240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.550284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.550284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.550284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.550284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.552621] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6ae9470-9886-4ba3-8ca9-956229fcdbe3 req-821add89-19b4-46ac-9e0b-7e141d1d4a40 service nova] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_rules [ 688.553094] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6ae9470-9886-4ba3-8ca9-956229fcdbe3 req-821add89-19b4-46ac-9e0b-7e141d1d4a40 service nova] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 688.553094] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6ae9470-9886-4ba3-8ca9-956229fcdbe3 req-821add89-19b4-46ac-9e0b-7e141d1d4a40 service nova] Enqueued Resource ID: 0f99b3f4-2618-4b49-a022-73e345a53ca5 with Priority: HIGHEST for action port [ 688.553465] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_rules [ 688.553613] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 688.553732] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f99b3f4-2618-4b49-a022-73e345a53ca5 with Priority: HIGHEST for action port [ 688.554035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.554159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.554258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.556188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.556188] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.556188] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.556188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.556188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.556378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.556543] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.556620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.561507] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.561507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f99b3f4-2618-4b49-a022-73e345a53ca5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.561507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.561507] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f99b3f4-2618-4b49-a022-73e345a53ca5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.564386] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 688.733612] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c9d161fc-7a83-4b17-b609-bbf352d47571 None None] Enqueued Resource ID: da045b87-836c-4916-a9b5-08308287aeda with Priority: HIGHEST for action port [ 688.734179] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da045b87-836c-4916-a9b5-08308287aeda with Priority: HIGHEST for action port [ 688.734470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-da045b87-836c-4916-a9b5-08308287aeda taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.734601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-da045b87-836c-4916-a9b5-08308287aeda" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.734684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-da045b87-836c-4916-a9b5-08308287aeda" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.735201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-da045b87-836c-4916-a9b5-08308287aeda" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.736112] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('da045b87-836c-4916-a9b5-08308287aeda',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.762400] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08ca3a55-006b-4d39-b149-85d24da1bce8 [ 688.762400] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.762400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.762400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.762641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.762641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.762749] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08ca3a55-006b-4d39-b149-85d24da1bce8 already deleted. [ 688.762855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ca3a55-006b-4d39-b149-85d24da1bce8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.063107] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.063208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.065976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.069190] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f99b3f4-2618-4b49-a022-73e345a53ca5 with status ACTIVE [ 689.069190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069190] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f99b3f4-2618-4b49-a022-73e345a53ca5 is going to be updated. [ 689.094528] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.095261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.095261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.095261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.095428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.095669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f99b3f4-2618-4b49-a022-73e345a53ca5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.238110] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port da045b87-836c-4916-a9b5-08308287aeda [ 689.238255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.238414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.238522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.238785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.238893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.239023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:da045b87-836c-4916-a9b5-08308287aeda already deleted. [ 689.239118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-da045b87-836c-4916-a9b5-08308287aeda" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.571711] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.073757] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.074044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.074044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.075518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.075518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.075634] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be created. [ 690.127291] env[66919]: INFO networking_nsxv3.common.synchronization [req-9ac19e32-51bb-4a8b-a398-3170bdccf830 req-78fbbeb5-3375-4431-842b-c617ac524453 tempest-InstanceActionsNegativeTestJSON-153317932 tempest-InstanceActionsNegativeTestJSON-153317932-project-member] Enqueued Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 690.128820] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 690.129262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.130259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.130259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.130259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.130259] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.130259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.130259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.130639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.130639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.130639] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.139574] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.139751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.139827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.140147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.141039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.156496] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: UNINITIALIZED for 2s [ 690.418513] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: SUCCESS [ 690.418513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.592184] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 690.592516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.636038] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.636038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.636217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.636302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.636381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.636572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.636672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.636736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.636945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.637047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.637138] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a already deleted. [ 690.637224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.748760] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-336 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.748760] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-336" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.749028] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-336" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.749142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-336" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.749399] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.749633] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.749710] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.749861] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.750023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.750242] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.750378] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.750540] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.750611] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.750721] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.750811] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.750936] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.770910] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.771089] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.771225] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.771483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-336" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.771812] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-93f6aec9-eadd-4764-94ff-b4dcccd376ff taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.771979] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.772106] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.772412] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.772546] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f6aec9-eadd-4764-94ff-b4dcccd376ff',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.278941] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.278941] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 93f6aec9-eadd-4764-94ff-b4dcccd376ff not found, creating... [ 691.278941] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.278941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.279533] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.279814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.279995] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.280248] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.280447] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.280523] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 93f6aec9-eadd-4764-94ff-b4dcccd376ff is going to be created. [ 691.302093] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.302425] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.302671] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.302962] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.303205] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.303426] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.844657] env[66919]: INFO networking_nsxv3.common.synchronization [req-132a803c-30e5-4ea1-ba64-9c3b36f1c95f req-064fcc3e-6e9c-4102-9484-5cde208b6c6d tempest-AttachInterfacesUnderV243Test-697435982 tempest-AttachInterfacesUnderV243Test-697435982-project-member] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 691.845438] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGHEST for action security_group_members [ 691.846506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.847286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.847286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.847286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.847286] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.847286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.847286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.847779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.847779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.847779] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.081847] env[66919]: INFO networking_nsxv3.common.synchronization [req-9ac19e32-51bb-4a8b-a398-3170bdccf830 req-e43472aa-abe9-4226-b5da-b0cab933c655 service nova] Enqueued Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_rules [ 692.082027] env[66919]: INFO networking_nsxv3.common.synchronization [req-9ac19e32-51bb-4a8b-a398-3170bdccf830 req-e43472aa-abe9-4226-b5da-b0cab933c655 service nova] Enqueued Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 692.082159] env[66919]: INFO networking_nsxv3.common.synchronization [req-9ac19e32-51bb-4a8b-a398-3170bdccf830 req-e43472aa-abe9-4226-b5da-b0cab933c655 service nova] Enqueued Resource ID: 93f6aec9-eadd-4764-94ff-b4dcccd376ff with Priority: HIGHEST for action port [ 692.082395] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_rules [ 692.082523] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 692.082651] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93f6aec9-eadd-4764-94ff-b4dcccd376ff with Priority: HIGHEST for action port [ 692.083534] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.083666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.083735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.084169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.084204] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.085516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.085839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.086033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.086239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.086402] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.086507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.086568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.086716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.086801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.086920] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.088999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-93f6aec9-eadd-4764-94ff-b4dcccd376ff taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.089138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.089216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.089452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.089551] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93f6aec9-eadd-4764-94ff-b4dcccd376ff',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.172130] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 692.172284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.172507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.172757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.173022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.173116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.173168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.173300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.173397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.173483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.173619] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.307384] env[66919]: INFO networking_nsxv3.common.synchronization [req-216a8104-7ab6-4e28-aa69-9897bd8be340 req-ae22f383-7a5f-418b-8650-764a27a37088 tempest-ServerMetadataNegativeTestJSON-1926245434 tempest-ServerMetadataNegativeTestJSON-1926245434-project-member] Enqueued Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 692.308321] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGHEST for action security_group_members [ 692.308321] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.308498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.308498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.309683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.309683] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.309683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.309683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.309683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.309683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.309683] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.349834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.349998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.350086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.350312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.350416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.350633] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.350738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.350800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.350992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.351112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.351219] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be updated. [ 692.390172] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.390172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.390172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.390335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.390427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.402734] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: IN_PROGRESS for 2s [ 692.592427] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.592427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.594537] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93f6aec9-eadd-4764-94ff-b4dcccd376ff with status ACTIVE [ 692.594840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.595016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.595182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.595659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.595659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.595752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.596410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.596410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.596410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.596410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.596410] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.596923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.596923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.596923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.596923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.596923] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93f6aec9-eadd-4764-94ff-b4dcccd376ff is going to be updated. [ 692.601544] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.626699] env[66919]: INFO networking_nsxv3.common.synchronization [req-172a4c4b-7bb6-42a5-a975-ae79f810975c req-04d11289-737b-4eb0-8a09-54eec2bd7f8f tempest-ServersNegativeTestJSON-918520820 tempest-ServersNegativeTestJSON-918520820-project-member] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 692.629352] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 692.630064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.630064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.630064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.630540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.630540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93f6aec9-eadd-4764-94ff-b4dcccd376ff" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633285] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.633285] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.633285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.633285] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.682023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.682023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.682023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.682023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.682023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.682753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.682753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.682753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.682753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.682753] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.817121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.817121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.817121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.817304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.817304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.817507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.817588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.817704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.817799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.817930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.818177] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa is going to be updated. [ 692.819899] env[66919]: INFO networking_nsxv3.common.synchronization [req-fba01ae9-ae16-43da-b821-c26795c3fc46 req-06dabab3-5e06-4b98-8ac8-b9fc13728262 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 692.820522] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 692.821973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.821973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.821973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.821973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.821973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.821973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.822720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.822832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.822887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.822949] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.860583] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.861633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.861744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.862012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.862195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.873551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: IN_PROGRESS for 2s [ 693.108528] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.137018] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.185910] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc0f601-8257-4527-8366-40ea56f5ccdd: rpc.has_security_group_logging(os_id): False [ 693.206275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.206551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.206663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.207508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.207664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.207993] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.208228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.208294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.209149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.209653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.209790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.209947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.210045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.210300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.210476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.211013] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.211416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.211523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.211759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.211988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.212140] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be created. [ 693.327686] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.327686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.327686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.327686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.328190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.335114] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.335273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.335328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.335519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.335600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.335804] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.335953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.335953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.336108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.336668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.336668] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 693.353679] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 693.376702] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.378821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.378821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.378821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.378821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.389605] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 693.610061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.610472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.610472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.610704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.611265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.611265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a is going to be created. [ 693.641285] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.645964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.646288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.646288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.646452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.646650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.657474] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: UNINITIALIZED for 2s [ 693.680682] env[66919]: INFO networking_nsxv3.common.synchronization [req-d1611006-9126-4d44-aeb6-e258df150ba5 req-bcc45825-f879-4ea8-9a42-cc7096b85d02 tempest-FloatingIPsAssociationTestJSON-1688354250 tempest-FloatingIPsAssociationTestJSON-1688354250-project-member] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 693.681270] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGHEST for action security_group_members [ 693.681577] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.681942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.681942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.682063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.682788] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.682788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.682788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.682788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.682788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.682788] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.145056] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.145056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.145249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.145382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.145420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.145524] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 694.187613] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.188068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.188068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.188553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.188553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.188642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.188755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.188840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.189032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.189133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.189276] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be updated. [ 694.194149] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.194149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.194149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.194149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.197282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.209317] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 694.256706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.256706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.256706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.256706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.256706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.272299] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: IN_PROGRESS for 2s [ 694.418620] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11de85e1-8fdb-4cd8-898c-db27313f960d in Status: SUCCESS [ 694.420201] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d deletion is rescheduled due to dependency. [ 694.420201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.891967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa in Status: SUCCESS [ 694.892250] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa deletion is rescheduled due to dependency. [ 694.892442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.369393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 695.369635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.402935] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 695.403296] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 695.403443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.671348] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: SUCCESS [ 695.671610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.672127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.672412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.672618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.672786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.672863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.674739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.674919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.674961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.675169] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.178699] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.178836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.178836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.179205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.179378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.179378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.179378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.179892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.179892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.179892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.179892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.180013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.180013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.180141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.181132] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.181132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.181132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.181132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.181132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.181132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.181132] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.219836] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 696.220122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.283934] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a88ee71-4c82-4813-b129-b022cced6be1 in Status: SUCCESS [ 696.284673] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 deletion is rescheduled due to dependency. [ 696.284673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.686124] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a3ab807-fc85-4c12-b831-97beee7da03a: rpc.has_security_group_logging(os_id): False [ 696.710878] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.710878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.710878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.710878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.715310] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.715310] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.715310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.717949] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.717949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.717949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.717949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.717949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.717949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a is going to be created. [ 696.795124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.797198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.797198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.797198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.797198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.813365] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: IN_PROGRESS for 2s [ 698.686511] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 698.686511] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 698.829802] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: SUCCESS [ 698.829802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.374109] env[66919]: INFO networking_nsxv3.common.synchronization [None req-2eab6f3b-efc7-4e6f-847f-386693995394 None None] Enqueued Resource ID: 1b9dfcfa-d674-426c-8c3f-08d31019a552 with Priority: HIGHEST for action port [ 699.374767] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b9dfcfa-d674-426c-8c3f-08d31019a552 with Priority: HIGHEST for action port [ 699.375134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b9dfcfa-d674-426c-8c3f-08d31019a552 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.375263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b9dfcfa-d674-426c-8c3f-08d31019a552" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.375332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b9dfcfa-d674-426c-8c3f-08d31019a552" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.375602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b9dfcfa-d674-426c-8c3f-08d31019a552" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.375684] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b9dfcfa-d674-426c-8c3f-08d31019a552',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.879388] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b9dfcfa-d674-426c-8c3f-08d31019a552 [ 699.879716] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.879839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.879897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.880697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.880697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.880697] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b9dfcfa-d674-426c-8c3f-08d31019a552 already deleted. [ 699.883972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b9dfcfa-d674-426c-8c3f-08d31019a552" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.036666] env[66919]: INFO networking_nsxv3.common.synchronization [None req-35d9fb39-01cd-4642-be4f-7d573c0e3050 None None] Enqueued Resource ID: fb912715-e30c-4a30-a61b-093e920bd5e3 with Priority: HIGHEST for action port [ 702.037909] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb912715-e30c-4a30-a61b-093e920bd5e3 with Priority: HIGHEST for action port [ 702.037909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb912715-e30c-4a30-a61b-093e920bd5e3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.037909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb912715-e30c-4a30-a61b-093e920bd5e3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.037909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb912715-e30c-4a30-a61b-093e920bd5e3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.038345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb912715-e30c-4a30-a61b-093e920bd5e3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.039301] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb912715-e30c-4a30-a61b-093e920bd5e3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.542978] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb912715-e30c-4a30-a61b-093e920bd5e3 [ 702.544208] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.544208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.544208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.544208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.544208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.544208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb912715-e30c-4a30-a61b-093e920bd5e3 already deleted. [ 702.544608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb912715-e30c-4a30-a61b-093e920bd5e3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.382411] env[66919]: INFO networking_nsxv3.common.synchronization [None req-50742492-31f3-452b-a802-f8815757cc59 None None] Enqueued Resource ID: abd5323a-4139-42bd-acbe-db5e50398064 with Priority: HIGHEST for action port [ 703.383758] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abd5323a-4139-42bd-acbe-db5e50398064 with Priority: HIGHEST for action port [ 703.384344] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-abd5323a-4139-42bd-acbe-db5e50398064 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.384513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-abd5323a-4139-42bd-acbe-db5e50398064" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.384650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-abd5323a-4139-42bd-acbe-db5e50398064" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.386921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-abd5323a-4139-42bd-acbe-db5e50398064" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.386921] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('abd5323a-4139-42bd-acbe-db5e50398064',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.647104] env[66919]: INFO networking_nsxv3.common.synchronization [req-61282ac8-0a98-4851-a8db-c126231c8521 req-22644108-4837-4c8f-9867-20942ceda0ae tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 703.648586] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 703.650137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.651863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.651863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.651863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.651863] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.651863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.652526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.652789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.652906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.653038] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.888960] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port abd5323a-4139-42bd-acbe-db5e50398064 [ 703.888960] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.889328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.889328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.889415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.889798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.889798] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:abd5323a-4139-42bd-acbe-db5e50398064 already deleted. [ 703.889798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-abd5323a-4139-42bd-acbe-db5e50398064" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.156080] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.156338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.156932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.156932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.156932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.157165] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.157373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.157373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.157604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.157748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.158365] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 704.192477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.192477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.192477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.192477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.192477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.202135] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 704.615751] env[66919]: INFO networking_nsxv3.common.synchronization [req-269a783c-ad37-4848-b6e4-3a5b688bdf15 req-b0007336-034f-43f9-bc80-a7be31237d1d tempest-ServersTestFqdnHostnames-742120818 tempest-ServersTestFqdnHostnames-742120818-project-member] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 704.616153] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGHEST for action security_group_members [ 704.616153] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.616247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.616528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.616528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.616655] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.616802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.616802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.617028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.617121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.617214] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.871749] env[66919]: INFO networking_nsxv3.common.synchronization [req-6cfcfbea-bdcd-450d-a8ba-d5b1fcc76581 req-b65be0c1-4016-4fff-b223-6f0abafc3ad1 tempest-ImagesOneServerTestJSON-1342717248 tempest-ImagesOneServerTestJSON-1342717248-project-member] Enqueued Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 704.872624] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGHEST for action security_group_members [ 704.872939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.873130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.873474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.873474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.873612] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.873707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.873768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.873936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.874069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.874165] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.036666] env[66919]: INFO networking_nsxv3.common.synchronization [req-80e056c2-1e34-45e2-a653-cef806ce2eed req-2ff1fc4c-f75d-4b99-8a34-698a69696e7b tempest-VolumesAssistedSnapshotsTest-235246620 tempest-VolumesAssistedSnapshotsTest-235246620-project-member] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 705.037376] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGHEST for action security_group_members [ 705.037739] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.038078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.038325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.038681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.038997] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.039208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.039336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.039570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.039950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.039950] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.120831] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.120945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.121042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.121357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.121504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.123253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.123253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.123253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.123253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.123253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.123253] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 is going to be updated. [ 705.161324] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.161324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.161324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.161324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.161683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.178322] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: IN_PROGRESS for 2s [ 705.377935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.379053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.379145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.379362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.379443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.379707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.379845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.379928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.380126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.380244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.380361] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a is going to be updated. [ 705.411535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.411670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.411760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.411947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.413671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.421702] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: IN_PROGRESS for 2s [ 705.542357] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.542580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.542677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.542841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.542953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.543264] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.543377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.543455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.543657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.543763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.544596] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b is going to be updated. [ 705.574536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.574810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.574810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.574968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.575121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.585183] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: IN_PROGRESS for 2s [ 705.605341] env[66919]: INFO networking_nsxv3.common.synchronization [req-3d1bb0d2-78cd-4a1c-bc93-3e2a97615bc3 req-1caf7085-f777-456c-b31e-0c5e217682a2 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 705.607536] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 705.607536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.607536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.607536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.607536] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.110818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.111132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.111132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.111390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.111536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.111827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.111962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.112102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.112302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.112411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.112765] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 706.139177] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.139360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.139435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.139643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.139782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.147476] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.148862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.149057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.149428] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.149797] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.150018] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.150185] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.150466] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.150642] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.150859] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.150973] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.151115] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.151337] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.151469] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.151576] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.151785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.156759] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 706.177579] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.177928] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.178101] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.178291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.178604] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.178783] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.178895] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.179240] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.179498] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fe75f0-f094-4cc5-8db7-522ff79c0bb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.214842] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 706.214842] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc deletion is rescheduled due to dependency. [ 706.214842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.685617] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.685838] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.685957] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.686473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.686670] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.686822] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 not found, creating... [ 706.687213] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.687363] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.687479] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.687745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.687891] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.688231] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.688331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.688439] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.688635] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.688782] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.688902] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 is going to be created. [ 706.711554] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.711554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.711554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.711554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.711554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.711554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.188725] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 in Status: SUCCESS [ 707.189122] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 deletion is rescheduled due to dependency. [ 707.189122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.212033] env[66919]: INFO networking_nsxv3.common.synchronization [None req-db757a01-1993-40e6-8f23-b85d8f8921a7 None None] Enqueued Resource ID: 75be8182-87b7-4744-a589-fbd5deaf781a with Priority: HIGHEST for action port [ 707.212418] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75be8182-87b7-4744-a589-fbd5deaf781a with Priority: HIGHEST for action port [ 707.212729] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-75be8182-87b7-4744-a589-fbd5deaf781a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.212868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75be8182-87b7-4744-a589-fbd5deaf781a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.213147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75be8182-87b7-4744-a589-fbd5deaf781a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.213418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75be8182-87b7-4744-a589-fbd5deaf781a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.213658] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75be8182-87b7-4744-a589-fbd5deaf781a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.431496] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 92110755-d0a0-45ce-81ab-f52b3527b07a in Status: SUCCESS [ 707.431851] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a deletion is rescheduled due to dependency. [ 707.432086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.493340] env[66919]: INFO networking_nsxv3.common.synchronization [req-3d1bb0d2-78cd-4a1c-bc93-3e2a97615bc3 req-81e0fc04-57d3-4059-81e3-20afc4edc43b service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 707.493535] env[66919]: INFO networking_nsxv3.common.synchronization [req-3d1bb0d2-78cd-4a1c-bc93-3e2a97615bc3 req-81e0fc04-57d3-4059-81e3-20afc4edc43b service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 707.493671] env[66919]: INFO networking_nsxv3.common.synchronization [req-3d1bb0d2-78cd-4a1c-bc93-3e2a97615bc3 req-81e0fc04-57d3-4059-81e3-20afc4edc43b service nova] Enqueued Resource ID: 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 with Priority: HIGHEST for action port [ 707.494270] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 707.495035] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 707.495035] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 with Priority: HIGHEST for action port [ 707.496398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.496517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.496587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.497307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.497307] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.499216] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.499310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.500552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.500552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.500552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.500552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.500552] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fe75f0-f094-4cc5-8db7-522ff79c0bb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.595606] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b in Status: SUCCESS [ 707.595785] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b deletion is rescheduled due to dependency. [ 707.595899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.716392] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75be8182-87b7-4744-a589-fbd5deaf781a [ 707.716659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.716829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.717015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.717349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.717413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.717486] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75be8182-87b7-4744-a589-fbd5deaf781a already deleted. [ 707.717555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75be8182-87b7-4744-a589-fbd5deaf781a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.000416] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.000553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.003028] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 with status ACTIVE [ 708.003236] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.003366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.003439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.003658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.003745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.003918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.004057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.004125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.004310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.004389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.004572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.004666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.004726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.004889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.004966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.005061] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07fe75f0-f094-4cc5-8db7-522ff79c0bb4 is going to be updated. [ 708.028414] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.028618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.028696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.028982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.029082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.029349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07fe75f0-f094-4cc5-8db7-522ff79c0bb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.040038] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a9461ee9-31a6-4c0a-87d0-7a302c7bc545 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 708.040038] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 708.040395] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.040517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.040573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.041177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.041177] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.122379] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b44a9a4e-44f9-4178-99ff-1333794a8323 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 708.122904] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 708.123207] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.123313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.168496] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 708.168690] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 708.168809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.168983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.169225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.169410] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.169524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.169588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.169738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.169846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.169913] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.563897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.563897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.563897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.563897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.563897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.564391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 already deleted. [ 708.564391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.564391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.564391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.564521] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.672996] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.085262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.085403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.085473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.085694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.085786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.085899] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 already deleted. [ 709.085977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.176474] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.678720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.679110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.679110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.679110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.679236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.679706] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 709.712606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.712809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.712851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.713052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.713199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.724169] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 711.034850] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5225c5a-f95f-49dd-8bd3-300995f249ad req-e8aa9112-1c9a-4e6b-aa64-f5dfa63aeb5e tempest-InstanceActionsV221TestJSON-1894487213 tempest-InstanceActionsV221TestJSON-1894487213-project-member] Enqueued Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 711.035964] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 711.036313] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.036482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.036546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.036822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.037072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.037184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.037265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.037430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.037944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.037944] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.396992] env[66919]: INFO networking_nsxv3.common.synchronization [None req-19c1eb59-5d88-43d0-9691-eb3bf30e632e None None] Enqueued Resource ID: db8d0b27-98c1-4260-bd0a-a678dc366787 with Priority: HIGHEST for action port [ 711.397802] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db8d0b27-98c1-4260-bd0a-a678dc366787 with Priority: HIGHEST for action port [ 711.397998] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-db8d0b27-98c1-4260-bd0a-a678dc366787 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.398103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db8d0b27-98c1-4260-bd0a-a678dc366787" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.398178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db8d0b27-98c1-4260-bd0a-a678dc366787" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.399973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db8d0b27-98c1-4260-bd0a-a678dc366787" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.401582] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db8d0b27-98c1-4260-bd0a-a678dc366787',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.466407] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-564 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.466591] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-564" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.467016] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-564" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.467093] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-564" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.468179] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.468538] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.468538] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.468603] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.468739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.468955] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.469074] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.469180] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.469292] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.469388] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.469485] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.469611] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.491458] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.491638] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.491771] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.491953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-564" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.492306] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.492490] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.492613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.493036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.493098] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.542453] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.542453] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.542453] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 already deleted. [ 711.542453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.736407] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 711.736723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.737125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.737343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.737546] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.739040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.739040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.739040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.739040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.739040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.739240] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.903401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db8d0b27-98c1-4260-bd0a-a678dc366787 [ 711.903876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.904074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.904182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.904412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.904533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.904654] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db8d0b27-98c1-4260-bd0a-a678dc366787 already deleted. [ 711.904847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db8d0b27-98c1-4260-bd0a-a678dc366787" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.995543] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.995765] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.995850] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.996151] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.996324] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.996560] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab not found, creating... [ 711.996846] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.997322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.997322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.997464] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.997603] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.997887] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.998258] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.998343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.998582] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.998926] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.998926] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab is going to be created. [ 712.021945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.022161] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.022311] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.022719] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.022788] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.022995] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.243774] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.244124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.244316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.244708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.245659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.245659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.245659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.246127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.246479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.246924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.249302] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.249399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.249450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.249617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.249771] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.249869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.249922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.250223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.250315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.250401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.250492] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.735094] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5225c5a-f95f-49dd-8bd3-300995f249ad req-cf8e8f0e-609a-49fb-962d-74d0fce03559 service nova] Enqueued Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_rules [ 712.735317] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5225c5a-f95f-49dd-8bd3-300995f249ad req-cf8e8f0e-609a-49fb-962d-74d0fce03559 service nova] Enqueued Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 712.735412] env[66919]: INFO networking_nsxv3.common.synchronization [req-f5225c5a-f95f-49dd-8bd3-300995f249ad req-cf8e8f0e-609a-49fb-962d-74d0fce03559 service nova] Enqueued Resource ID: ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab with Priority: HIGHEST for action port [ 712.735940] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_rules [ 712.736173] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 712.736452] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab with Priority: HIGHEST for action port [ 712.736627] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.736771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.736876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.737191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.737294] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.739376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.739376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.739376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.741094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.741094] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.742404] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.745019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.745019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.745019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.745019] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.755052] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 712.757516] env[66919]: INFO networking_nsxv3.common.synchronization [req-03e8f45b-03a5-4daf-93ae-a75a0b723644 req-d8b45f74-cd15-4586-9a52-590f460869c9 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 712.758249] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 712.759141] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.759280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.759354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.763132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.763132] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.763132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.763132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.763132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.763132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.763132] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.777359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.777540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.777685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.778309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.778473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.778740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.779042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.779149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.779641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.779777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.780029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.780533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.780639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.780820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.780928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.781167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.781451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.781626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.781856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.781944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.782072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 712.847672] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.847817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.848543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.848543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.848543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.861265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 712.983817] env[66919]: INFO networking_nsxv3.common.synchronization [None req-1f45b595-4490-4b11-9a11-d3edeb1fc695 None None] Enqueued Resource ID: 754f6a59-fbf0-43cb-8503-ec573aee44ab with Priority: HIGHEST for action port [ 712.983817] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754f6a59-fbf0-43cb-8503-ec573aee44ab with Priority: HIGHEST for action port [ 712.983817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-754f6a59-fbf0-43cb-8503-ec573aee44ab taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.983817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-754f6a59-fbf0-43cb-8503-ec573aee44ab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.983817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-754f6a59-fbf0-43cb-8503-ec573aee44ab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.984106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-754f6a59-fbf0-43cb-8503-ec573aee44ab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.984221] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('754f6a59-fbf0-43cb-8503-ec573aee44ab',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.063022] env[66919]: INFO networking_nsxv3.common.synchronization [req-4b10e7b4-84c9-4002-aa65-645b3407189f req-a4123727-08fd-4282-859f-349f21741184 tempest-InstanceActionsNegativeTestJSON-153317932 tempest-InstanceActionsNegativeTestJSON-153317932-project-member] Enqueued Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 713.063953] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGHEST for action security_group_members [ 713.064499] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.065148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.065324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.065603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.065839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.066480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.066647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.066934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.067156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.067499] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.245532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.245928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.246101] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.247682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab with status ACTIVE [ 713.247940] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.248267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.248267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.248480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.248577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.248776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.249262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.249337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.249889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.249889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.250039] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.251585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.251585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.251585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.251585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.251585] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab is going to be updated. [ 713.263275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.263495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.263630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.263893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.264082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.264306] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.264440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.264510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.264725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.264810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.265038] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 713.280722] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.280886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.281834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.281834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.281834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.281834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca2c4e46-0ba3-4c2e-8d0b-789a6bdabfab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.313255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.313370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.313370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.313566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.313705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.322786] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 713.490548] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 754f6a59-fbf0-43cb-8503-ec573aee44ab [ 713.490548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.490548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.490548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.490548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.490548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.490548] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:754f6a59-fbf0-43cb-8503-ec573aee44ab already deleted. [ 713.490548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-754f6a59-fbf0-43cb-8503-ec573aee44ab" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.569616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.569773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.569842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.570094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.570197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.571137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.571282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.571402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.571532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.571617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.571713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a is going to be updated. [ 713.616333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.616525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.617301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.617301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.617301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.628970] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: IN_PROGRESS for 2s [ 713.741873] env[66919]: INFO networking_nsxv3.common.synchronization [req-c15e486e-6c6d-41fa-b415-7f4b506c882f req-4f1de84e-02f4-4c6e-9026-ebb29e34d013 tempest-AttachInterfacesV270Test-837607725 tempest-AttachInterfacesV270Test-837607725-project-member] Enqueued Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 713.742573] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 713.742728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.742820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.742874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.744917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.745127] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.745250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.745319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.745507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.745595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.745688] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.756172] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.177608] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.177916] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-631" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.178104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-631" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.179550] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-631" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.179550] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.179550] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.179550] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.179550] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.179855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.179855] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.179914] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.180644] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.180644] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.180644] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.180644] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.180644] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.204200] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.204432] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.204631] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.204856] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-631" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.205409] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-f6ef3a4f-d60c-44f7-b573-906b39082ec9 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.205409] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.207053] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.207053] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.209268] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ef3a4f-d60c-44f7-b573-906b39082ec9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.252992] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.253300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.253300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.253576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.253713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.253999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.254156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.254259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.254478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.254598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.254724] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c already deleted. [ 714.254844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.260148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.260539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.260617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.261287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.261452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.262012] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 is going to be created. [ 714.321898] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.322080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.322156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.322392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.322557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.335056] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: UNINITIALIZED for 2s [ 714.715025] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.715025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port f6ef3a4f-d60c-44f7-b573-906b39082ec9 not found, creating... [ 714.715025] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.715025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.715511] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.715511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.715511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.715511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.715511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.715511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: f6ef3a4f-d60c-44f7-b573-906b39082ec9 is going to be created. [ 714.739468] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.739633] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.739746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.740022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.740379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.740434] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.834313] env[66919]: INFO networking_nsxv3.common.synchronization [None req-03b7e3b6-8a2d-4cf8-b577-ad5f74497a3b None None] Enqueued Resource ID: 16044c11-d8d8-479d-ac43-9beb3a0cc451 with Priority: HIGHEST for action port [ 714.835466] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16044c11-d8d8-479d-ac43-9beb3a0cc451 with Priority: HIGHEST for action port [ 714.835753] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-16044c11-d8d8-479d-ac43-9beb3a0cc451 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.836116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16044c11-d8d8-479d-ac43-9beb3a0cc451" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.836116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16044c11-d8d8-479d-ac43-9beb3a0cc451" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.836349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16044c11-d8d8-479d-ac43-9beb3a0cc451" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.836445] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16044c11-d8d8-479d-ac43-9beb3a0cc451',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.878446] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 714.878746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.314793] env[66919]: INFO networking_nsxv3.common.synchronization [None req-6a4370c4-4f93-4695-901d-43de16b67bd0 None None] Enqueued Resource ID: 83075a20-a0da-41c1-ad94-b2ebd1a9db5c with Priority: HIGHEST for action port [ 715.315344] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83075a20-a0da-41c1-ad94-b2ebd1a9db5c with Priority: HIGHEST for action port [ 715.316728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-83075a20-a0da-41c1-ad94-b2ebd1a9db5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.318028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83075a20-a0da-41c1-ad94-b2ebd1a9db5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.318028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83075a20-a0da-41c1-ad94-b2ebd1a9db5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.318028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83075a20-a0da-41c1-ad94-b2ebd1a9db5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.318028] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83075a20-a0da-41c1-ad94-b2ebd1a9db5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.333762] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 715.334486] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 715.334823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.338829] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 16044c11-d8d8-479d-ac43-9beb3a0cc451 [ 715.340036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.340036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.340036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.340251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.340251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.340305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:16044c11-d8d8-479d-ac43-9beb3a0cc451 already deleted. [ 715.340386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16044c11-d8d8-479d-ac43-9beb3a0cc451" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.466481] env[66919]: INFO networking_nsxv3.common.synchronization [req-c15e486e-6c6d-41fa-b415-7f4b506c882f req-521e006d-e4af-4fc6-a1d5-3c5afd605c06 service nova] Enqueued Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_rules [ 715.466481] env[66919]: INFO networking_nsxv3.common.synchronization [req-c15e486e-6c6d-41fa-b415-7f4b506c882f req-521e006d-e4af-4fc6-a1d5-3c5afd605c06 service nova] Enqueued Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 715.466481] env[66919]: INFO networking_nsxv3.common.synchronization [req-c15e486e-6c6d-41fa-b415-7f4b506c882f req-521e006d-e4af-4fc6-a1d5-3c5afd605c06 service nova] Enqueued Resource ID: f6ef3a4f-d60c-44f7-b573-906b39082ec9 with Priority: HIGHEST for action port [ 715.467457] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_rules [ 715.467656] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 715.467757] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6ef3a4f-d60c-44f7-b573-906b39082ec9 with Priority: HIGHEST for action port [ 715.469639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.469639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.469639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.469639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.469639] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.470089] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.470237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.470320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.470520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.475011] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.475011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.475011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.475011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.475011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.475011] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.475826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6ef3a4f-d60c-44f7-b573-906b39082ec9 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.475826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.475934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.476133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.476133] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6ef3a4f-d60c-44f7-b573-906b39082ec9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.640065] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a3ab807-fc85-4c12-b831-97beee7da03a in Status: SUCCESS [ 715.640281] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a deletion is rescheduled due to dependency. [ 715.640392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.821231] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83075a20-a0da-41c1-ad94-b2ebd1a9db5c [ 715.821486] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.821619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.821689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.821903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.821998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.822109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83075a20-a0da-41c1-ad94-b2ebd1a9db5c already deleted. [ 715.822186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83075a20-a0da-41c1-ad94-b2ebd1a9db5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.977708] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.977856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.978997] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.981373] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6ef3a4f-d60c-44f7-b573-906b39082ec9 with status ACTIVE [ 715.981373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.981373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.981373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.986772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.986944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.987248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.987440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.987562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.987760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.987870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.987986] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6ef3a4f-d60c-44f7-b573-906b39082ec9 is going to be updated. [ 716.012262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.012596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.012700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.012911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.013062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.013247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6ef3a4f-d60c-44f7-b573-906b39082ec9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.117616] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c9e5eeed-8e01-4e01-a5e9-92607771f0c9 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 716.117616] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 716.117616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.117616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.117616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.117616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.117616] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.242338] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d1de36fc-5e2f-4188-b322-defce73d2663 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 716.247204] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 716.247932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.248150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.345416] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: SUCCESS [ 716.345700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.345904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.346154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.346400] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.346540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.346611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.346800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.346946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.347063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.347170] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.490653] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.630193] env[66919]: INFO networking_nsxv3.common.synchronization [req-4128f492-7484-4314-82e4-adae61a3c543 req-05321fee-54cb-42e1-b195-cae5e1b6f7a7 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 716.630762] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 716.631642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.631784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.631883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.632133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.632396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.632622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.632689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.632864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.633054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.633185] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.637885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.638415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.638571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.638783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.638953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.639307] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 already deleted. [ 716.639433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.640247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.640447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.640589] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.851050] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.851273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.851330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.851564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.851748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.851856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.851922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.852147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.852265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.852417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.852606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.852728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.853050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.853050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.853421] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.853421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.853421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.853421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.853562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.853724] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.853851] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.993540] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.995988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.995988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.995988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.995988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.995988] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c is going to be created. [ 717.015362] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.017021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.017021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.017021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.017470] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.017796] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.020601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.020601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.020601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.020601] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.020601] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.020601] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.020601] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.020601] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 717.020601] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.020601] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.025695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.025844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.025923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.026262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.026423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.039764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: UNINITIALIZED for 2s [ 717.045186] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.045350] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.047777] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.048123] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.048511] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.048698] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.048811] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.049157] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.049295] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cdf9b05-6ce6-4767-a1ac-1c4d491025fb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.135949] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.165336] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.165570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.165570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.165755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.165845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.165949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 already deleted. [ 717.166047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.357246] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7c20e0ac-3cc6-4d82-99dc-7e144a069371: rpc.has_security_group_logging(os_id): False [ 717.378606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.378775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.378919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.379042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.380680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.380937] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.381103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.381186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.381374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.381477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.381682] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.381787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.381849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.381994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.382089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.382265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.382359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.382418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.382557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.382630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.382712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 is going to be created. [ 717.441880] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.442051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.442189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.442433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.442638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.454692] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: IN_PROGRESS for 2s [ 717.551451] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.551666] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.551789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.552089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.552238] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.552389] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb not found, creating... [ 717.555344] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.555629] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.555712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.555953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.556115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.556448] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.556582] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.556690] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.556965] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.557483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.557590] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb is going to be created. [ 717.600698] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.601022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.601182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.601471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.601737] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.601971] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.638700] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.141831] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.142154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.142154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.142376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.142467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.142562] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 718.201506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.201720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.201837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.202084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.202270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.215354] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 718.323763] env[66919]: INFO networking_nsxv3.common.synchronization [req-4128f492-7484-4314-82e4-adae61a3c543 req-c5a80d12-d113-462f-9d24-da9d0549bb3b service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 718.323930] env[66919]: INFO networking_nsxv3.common.synchronization [req-4128f492-7484-4314-82e4-adae61a3c543 req-c5a80d12-d113-462f-9d24-da9d0549bb3b service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 718.324079] env[66919]: INFO networking_nsxv3.common.synchronization [req-4128f492-7484-4314-82e4-adae61a3c543 req-c5a80d12-d113-462f-9d24-da9d0549bb3b service nova] Enqueued Resource ID: 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb with Priority: HIGHEST for action port [ 718.324613] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 718.324743] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 718.324859] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb with Priority: HIGHEST for action port [ 718.325160] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.325312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.325343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.325531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.325618] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.329326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.329326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.329326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.329326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.329326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.329326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.329326] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cdf9b05-6ce6-4767-a1ac-1c4d491025fb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.831337] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.831629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.831629] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb with status ACTIVE [ 718.831780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.831884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.834018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.834018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.834018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.834018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cdf9b05-6ce6-4767-a1ac-1c4d491025fb is going to be updated. [ 718.862074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.862265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.862360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.862573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.862710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.862868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cdf9b05-6ce6-4767-a1ac-1c4d491025fb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.062728] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: SUCCESS [ 719.062728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.062946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.063154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.063888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.063888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.063888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.063888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.063888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.063888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.064240] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.466539] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: SUCCESS [ 719.466765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.568529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.570041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.570041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.570560] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.570560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.570560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.570560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.570743] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.570812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.570812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.571011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.571101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.571212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.571318] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.073990] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c: rpc.has_security_group_logging(os_id): False [ 720.095643] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.095798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.095861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.096145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.096427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.096492] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.096594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.096632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.096781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.096862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.097072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.097173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.097477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.097477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.097477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.097605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.097868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.097868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.097868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.097999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.098660] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c is going to be created. [ 720.184580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.184742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.184787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.185389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.185539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.213848] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: IN_PROGRESS for 2s [ 720.230166] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 4s [ 722.234689] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: SUCCESS [ 722.235255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.243208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 722.243497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.243710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.243942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.244712] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.244712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.244712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.245431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.245499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.245650] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.621833] env[66919]: INFO networking_nsxv3.common.synchronization [None req-00c9579d-96b0-450d-bd86-f618fe6b45cf None None] Enqueued Resource ID: 2a1384fe-f101-45c3-bfeb-ecee277ed38b with Priority: HIGHEST for action port [ 722.621833] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a1384fe-f101-45c3-bfeb-ecee277ed38b with Priority: HIGHEST for action port [ 722.621833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a1384fe-f101-45c3-bfeb-ecee277ed38b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.621833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a1384fe-f101-45c3-bfeb-ecee277ed38b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.622176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a1384fe-f101-45c3-bfeb-ecee277ed38b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.622176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a1384fe-f101-45c3-bfeb-ecee277ed38b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.622272] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a1384fe-f101-45c3-bfeb-ecee277ed38b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.749030] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.125516] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a1384fe-f101-45c3-bfeb-ecee277ed38b [ 723.125516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.125516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.125516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.125516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.125516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.125516] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a1384fe-f101-45c3-bfeb-ecee277ed38b already deleted. [ 723.125516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a1384fe-f101-45c3-bfeb-ecee277ed38b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.253291] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.756462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.756462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.756650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.756747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.756834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.757114] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 723.794197] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.795153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.795153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.795153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.795153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.812112] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 723.930654] env[66919]: INFO networking_nsxv3.common.synchronization [req-bfc4563c-7c99-43a0-a355-d08fba1d4e9a req-b3ba299e-5516-4fcf-b9a5-31d0a0f3857e tempest-FloatingIPsAssociationNegativeTestJSON-1499238197 tempest-FloatingIPsAssociationNegativeTestJSON-1499238197-project-member] Enqueued Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 723.931189] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGHEST for action security_group_members [ 723.931532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.931659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.931728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.931962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.933428] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.933536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.933604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.937029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.937029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.937029] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.151802] env[66919]: INFO networking_nsxv3.common.synchronization [req-e96d0411-8f8a-4cb0-a8b2-09564689c411 req-208154ef-5ab5-4ad4-b0c5-d033ea08f5e0 tempest-InstanceActionsV221TestJSON-1894487213 tempest-InstanceActionsV221TestJSON-1894487213-project-member] Enqueued Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 724.152503] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGHEST for action security_group_members [ 724.152853] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.153009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.153085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.153265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.153425] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.153525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.153578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.153763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.153825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.154048] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.438404] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.438786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.438786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.438897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.439735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.439735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.439735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.439735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.439735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.439735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.440040] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa is going to be updated. [ 724.482078] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.482482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.482482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.482482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.482622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.494271] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: IN_PROGRESS for 2s [ 724.527433] env[66919]: INFO networking_nsxv3.common.synchronization [None req-07411944-964d-4342-8150-d75c670c7420 None None] Enqueued Resource ID: ae447211-b012-4f8a-af7b-34872bfb9485 with Priority: HIGHEST for action port [ 724.530967] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae447211-b012-4f8a-af7b-34872bfb9485 with Priority: HIGHEST for action port [ 724.531470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae447211-b012-4f8a-af7b-34872bfb9485 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.531653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae447211-b012-4f8a-af7b-34872bfb9485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.531749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae447211-b012-4f8a-af7b-34872bfb9485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.532077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae447211-b012-4f8a-af7b-34872bfb9485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.532609] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae447211-b012-4f8a-af7b-34872bfb9485',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.660639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.663110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.663110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.663367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.663730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.663730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.663864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.663906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.664098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.664160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.664233] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 is going to be updated. [ 724.670221] env[66919]: INFO networking_nsxv3.common.synchronization [None req-bf8777c6-ff72-46ff-a3f9-769945459cbd None None] Enqueued Resource ID: 5d25a3e7-0eb6-4636-b6bc-95bdf36425f7 with Priority: HIGHEST for action port [ 724.671524] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d25a3e7-0eb6-4636-b6bc-95bdf36425f7 with Priority: HIGHEST for action port [ 724.671926] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d25a3e7-0eb6-4636-b6bc-95bdf36425f7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.672114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d25a3e7-0eb6-4636-b6bc-95bdf36425f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.672196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d25a3e7-0eb6-4636-b6bc-95bdf36425f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.672493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d25a3e7-0eb6-4636-b6bc-95bdf36425f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.672610] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d25a3e7-0eb6-4636-b6bc-95bdf36425f7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.698923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.698923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.698923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.698923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.698923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.712124] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: IN_PROGRESS for 2s [ 725.035366] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ae447211-b012-4f8a-af7b-34872bfb9485 [ 725.035652] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.035652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.035793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.036053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.036138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.036783] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ae447211-b012-4f8a-af7b-34872bfb9485 already deleted. [ 725.036783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae447211-b012-4f8a-af7b-34872bfb9485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.174986] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d25a3e7-0eb6-4636-b6bc-95bdf36425f7 [ 725.175833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.175833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.175833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.175833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.175833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.175833] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d25a3e7-0eb6-4636-b6bc-95bdf36425f7 already deleted. [ 725.176152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d25a3e7-0eb6-4636-b6bc-95bdf36425f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.828745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 725.829028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.829168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.829387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.829983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.829983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.829983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.829983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.829983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.830249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.830249] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.335230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.335230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.335230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.335496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.335584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.335708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.335745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.335890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.335988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.336085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.336231] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.336418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.336418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.336544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.336637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.336720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.337790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.337790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.337790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.337790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.337790] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.507802] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ae71be-f061-446d-96fb-cc2053e285fa in Status: SUCCESS [ 726.507802] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa deletion is rescheduled due to dependency. [ 726.507802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.722769] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 in Status: SUCCESS [ 726.724018] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 deletion is rescheduled due to dependency. [ 726.724018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.824879] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b69fd727-7d79-49c3-9e20-919df7f3594e None None] Enqueued Resource ID: 4faf1b40-c5dc-447f-91f4-166e9b2c77a1 with Priority: HIGHEST for action port [ 726.825132] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4faf1b40-c5dc-447f-91f4-166e9b2c77a1 with Priority: HIGHEST for action port [ 726.825339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4faf1b40-c5dc-447f-91f4-166e9b2c77a1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.825463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4faf1b40-c5dc-447f-91f4-166e9b2c77a1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.825530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4faf1b40-c5dc-447f-91f4-166e9b2c77a1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.826505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4faf1b40-c5dc-447f-91f4-166e9b2c77a1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.826619] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4faf1b40-c5dc-447f-91f4-166e9b2c77a1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.840464] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb: rpc.has_security_group_logging(os_id): False [ 726.861148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.861148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.861148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.861148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.861148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.861148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.861382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.861382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.861382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.861480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.861897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.861897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.861897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.862100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.862100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.862179] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.862249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.862297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.862438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.862513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.862596] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 726.930457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.930620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.930665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.930872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.931098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.944399] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 727.297477] env[66919]: INFO networking_nsxv3.common.synchronization [None req-78566816-1bff-4fb4-8524-c0bdb810422d None None] Enqueued Resource ID: 938ecd96-6b8c-4eee-b09d-1e17cfb93784 with Priority: HIGHEST for action port [ 727.300628] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 938ecd96-6b8c-4eee-b09d-1e17cfb93784 with Priority: HIGHEST for action port [ 727.300628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-938ecd96-6b8c-4eee-b09d-1e17cfb93784 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.300628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-938ecd96-6b8c-4eee-b09d-1e17cfb93784" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.300628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-938ecd96-6b8c-4eee-b09d-1e17cfb93784" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.300628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-938ecd96-6b8c-4eee-b09d-1e17cfb93784" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.300628] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('938ecd96-6b8c-4eee-b09d-1e17cfb93784',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.331497] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4faf1b40-c5dc-447f-91f4-166e9b2c77a1 [ 727.331834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.332454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.332572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.334209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.334382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.334593] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4faf1b40-c5dc-447f-91f4-166e9b2c77a1 already deleted. [ 727.334635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4faf1b40-c5dc-447f-91f4-166e9b2c77a1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.804137] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 938ecd96-6b8c-4eee-b09d-1e17cfb93784 [ 727.804378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.804519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.804598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.804835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.804953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.805067] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:938ecd96-6b8c-4eee-b09d-1e17cfb93784 already deleted. [ 727.805149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-938ecd96-6b8c-4eee-b09d-1e17cfb93784" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.634534] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3562d708-1f36-4aac-8515-ef8f1e47a0cd None None] Enqueued Resource ID: 7ce097c9-3324-4d75-b740-0de9a6768b7e with Priority: HIGHEST for action port [ 728.635164] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce097c9-3324-4d75-b740-0de9a6768b7e with Priority: HIGHEST for action port [ 728.635423] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce097c9-3324-4d75-b740-0de9a6768b7e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.635547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce097c9-3324-4d75-b740-0de9a6768b7e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.635614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce097c9-3324-4d75-b740-0de9a6768b7e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.635862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce097c9-3324-4d75-b740-0de9a6768b7e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.635966] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce097c9-3324-4d75-b740-0de9a6768b7e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.962188] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 728.962188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.141751] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce097c9-3324-4d75-b740-0de9a6768b7e [ 729.141751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.141751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.141751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.141930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.142077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.142139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce097c9-3324-4d75-b740-0de9a6768b7e already deleted. [ 729.142245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce097c9-3324-4d75-b740-0de9a6768b7e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.361271] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d43fe632-60f7-44d7-bbfa-0521198112d5 None None] Enqueued Resource ID: 130abdee-1e6c-4c27-a862-fbf0e8b3f6f6 with Priority: HIGHEST for action port [ 729.361271] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 130abdee-1e6c-4c27-a862-fbf0e8b3f6f6 with Priority: HIGHEST for action port [ 729.362448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-130abdee-1e6c-4c27-a862-fbf0e8b3f6f6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.362725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-130abdee-1e6c-4c27-a862-fbf0e8b3f6f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.362897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-130abdee-1e6c-4c27-a862-fbf0e8b3f6f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.363317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-130abdee-1e6c-4c27-a862-fbf0e8b3f6f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.363470] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('130abdee-1e6c-4c27-a862-fbf0e8b3f6f6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.867422] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 130abdee-1e6c-4c27-a862-fbf0e8b3f6f6 [ 729.867740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.867816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.868016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.868158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.868975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.868975] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:130abdee-1e6c-4c27-a862-fbf0e8b3f6f6 already deleted. [ 729.868975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-130abdee-1e6c-4c27-a862-fbf0e8b3f6f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.202732] env[66919]: INFO networking_nsxv3.common.synchronization [None req-06c07064-6457-4177-9a45-b540b476d6a3 None None] Enqueued Resource ID: f593ae28-d444-4bce-802a-e9f94866a716 with Priority: HIGHEST for action port [ 730.203552] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f593ae28-d444-4bce-802a-e9f94866a716 with Priority: HIGHEST for action port [ 730.203723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f593ae28-d444-4bce-802a-e9f94866a716 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.203866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f593ae28-d444-4bce-802a-e9f94866a716" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.203926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f593ae28-d444-4bce-802a-e9f94866a716" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.209517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f593ae28-d444-4bce-802a-e9f94866a716" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.209652] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f593ae28-d444-4bce-802a-e9f94866a716',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.359273] env[66919]: INFO networking_nsxv3.common.synchronization [req-c2abf2f4-1070-46f5-a44d-67910f3363a4 req-6387fe94-070c-4226-a95b-c7ccc457ef65 tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 730.360382] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 730.360382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.360382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.360382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.360602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.360632] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.360777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.361126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.361200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.361315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.361474] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.714796] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f593ae28-d444-4bce-802a-e9f94866a716 [ 730.715145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.715296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.715369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.715594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.715685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.715794] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f593ae28-d444-4bce-802a-e9f94866a716 already deleted. [ 730.715862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f593ae28-d444-4bce-802a-e9f94866a716" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.866477] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.110021] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e593b404-9e51-4928-9b3b-75d454eb1402 None None] Enqueued Resource ID: 9f7a8fc9-1728-4d2e-bca2-deec8248902d with Priority: HIGHEST for action port [ 731.110021] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f7a8fc9-1728-4d2e-bca2-deec8248902d with Priority: HIGHEST for action port [ 731.110464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9f7a8fc9-1728-4d2e-bca2-deec8248902d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.110464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9f7a8fc9-1728-4d2e-bca2-deec8248902d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.110552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9f7a8fc9-1728-4d2e-bca2-deec8248902d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.110982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9f7a8fc9-1728-4d2e-bca2-deec8248902d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.111059] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9f7a8fc9-1728-4d2e-bca2-deec8248902d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.367019] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.613797] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9f7a8fc9-1728-4d2e-bca2-deec8248902d [ 731.614141] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.614327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.614424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.614899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.614899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.615050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9f7a8fc9-1728-4d2e-bca2-deec8248902d already deleted. [ 731.615151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9f7a8fc9-1728-4d2e-bca2-deec8248902d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.873707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.873707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.873816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.874096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.874096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.874240] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 731.907338] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.907490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.907563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.907778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.907938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.918161] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 732.443406] env[66919]: INFO networking_nsxv3.common.synchronization [None req-378259d5-ef3a-45c1-913f-d735f103b9d4 None None] Enqueued Resource ID: 5a9dc59d-fda8-433a-924e-79b1b37882fc with Priority: HIGHEST for action port [ 732.443406] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a9dc59d-fda8-433a-924e-79b1b37882fc with Priority: HIGHEST for action port [ 732.443406] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a9dc59d-fda8-433a-924e-79b1b37882fc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.443837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a9dc59d-fda8-433a-924e-79b1b37882fc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.443837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a9dc59d-fda8-433a-924e-79b1b37882fc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.446166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a9dc59d-fda8-433a-924e-79b1b37882fc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.446271] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a9dc59d-fda8-433a-924e-79b1b37882fc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.953966] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5a9dc59d-fda8-433a-924e-79b1b37882fc [ 732.954234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.954393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.954471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.954647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.954727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.954877] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5a9dc59d-fda8-433a-924e-79b1b37882fc already deleted. [ 732.954928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a9dc59d-fda8-433a-924e-79b1b37882fc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.174975] env[66919]: INFO networking_nsxv3.common.synchronization [None req-bd2c75fd-4046-4958-9140-ef568083b8fb tempest-ServersTestManualDisk-1328103097 tempest-ServersTestManualDisk-1328103097-project-member] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 733.175609] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 733.175916] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.176056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.176128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.176394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.176488] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.498558] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ccc10dd0-3dfd-4932-a157-f9d90532d725 tempest-ServersTestManualDisk-1328103097 tempest-ServersTestManualDisk-1328103097-project-member] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 733.498558] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 733.498558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.498558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.698991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.699080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.699176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.699391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.699487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.699586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db already deleted. [ 733.699671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.699824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.700122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.700122] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.928916] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 733.929173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.222763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.222948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.223016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.223313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.223431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.223545] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db already deleted. [ 734.223638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.703988] env[66919]: INFO networking_nsxv3.common.synchronization [req-5d0b5961-d923-47b3-b0f8-5e656e2a8886 req-9e2e10a8-f505-46df-81e7-c2e3d982ba36 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 735.704620] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 735.705123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.705243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.705290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.705485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.705593] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.705691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.705750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.705893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.705979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.706112] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.042340] env[66919]: INFO networking_nsxv3.common.synchronization [req-2fdda0b0-7691-4bbf-9284-768c39dd2480 req-c613f587-a487-4cac-8d1c-1ee81a20170c tempest-AttachInterfacesV270Test-837607725 tempest-AttachInterfacesV270Test-837607725-project-member] Enqueued Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 736.042340] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGHEST for action security_group_members [ 736.042340] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.042551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.042551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.042775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.042937] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.043070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.043132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.043288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.043401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.043717] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.114493] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.114493] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.114655] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.114983] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.115129] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.115806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.115806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.115806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.115806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.115985] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.116250] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.116509] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.116736] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.116893] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.117073] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.117260] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.137621] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.137776] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.137914] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.138099] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.138636] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-bdf3bd43-88e3-4369-bf28-f01528bed7f6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.138865] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.138979] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.139375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.140652] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf3bd43-88e3-4369-bf28-f01528bed7f6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.209153] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.428927] env[66919]: INFO networking_nsxv3.common.synchronization [req-081c7749-3a89-4da5-af9e-b076a2a3eea3 req-35c7bee0-568a-4b9e-803a-6a94ddee61ad tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 736.429468] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 736.429762] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.429920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.429965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.430201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.430359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.430458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.430519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.430669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.430754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.430841] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.550229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.550229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.550229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.550229] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c is going to be updated. [ 736.582972] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.582972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.582972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.582972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.582972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.595912] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: IN_PROGRESS for 2s [ 736.646416] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.646656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.646782] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.647179] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.647329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.647511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port bdf3bd43-88e3-4369-bf28-f01528bed7f6 not found, creating... [ 736.647816] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.647984] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.648118] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.648398] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.648557] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.648878] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.649088] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.649224] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.649452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.649603] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.649755] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: bdf3bd43-88e3-4369-bf28-f01528bed7f6 is going to be created. [ 736.671073] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.671292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.672031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.672031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.672031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.672203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.712917] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.799294] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.799488] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.799609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.799874] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.800138] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.800291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.800399] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.800607] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.800745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.800947] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.801268] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.801399] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.801505] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.801612] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.801711] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.801835] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.823119] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.823360] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.823505] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.823671] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.823977] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.824168] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.824282] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.824580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.824713] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25479d5f-215c-4d3a-bc90-2062f1c8c6e4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.934250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.934250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.934250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.934250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.934250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.934250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.934517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.934517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.934693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.934804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.934922] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 already deleted. [ 736.935051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.215871] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.216138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.216228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.216475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.216605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.216720] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 737.266336] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.266544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.266600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.266886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.267095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.278472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 737.326744] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.326992] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.327193] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.327479] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.327627] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.327803] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 not found, creating... [ 737.328086] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.328242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.328366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.328589] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.328736] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.329060] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.329250] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.329382] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.329604] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.329736] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.329886] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 is going to be created. [ 737.354040] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.354258] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.354365] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.354638] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.354865] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.355089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.402839] env[66919]: INFO networking_nsxv3.common.synchronization [req-5d0b5961-d923-47b3-b0f8-5e656e2a8886 req-fc7850a3-2944-4f31-aa97-0f2a09ee3bd8 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 737.403029] env[66919]: INFO networking_nsxv3.common.synchronization [req-5d0b5961-d923-47b3-b0f8-5e656e2a8886 req-fc7850a3-2944-4f31-aa97-0f2a09ee3bd8 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 737.403248] env[66919]: INFO networking_nsxv3.common.synchronization [req-5d0b5961-d923-47b3-b0f8-5e656e2a8886 req-fc7850a3-2944-4f31-aa97-0f2a09ee3bd8 service nova] Enqueued Resource ID: bdf3bd43-88e3-4369-bf28-f01528bed7f6 with Priority: HIGHEST for action port [ 737.403505] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 737.403631] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 737.403728] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdf3bd43-88e3-4369-bf28-f01528bed7f6 with Priority: HIGHEST for action port [ 737.404428] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.404557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.404821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.405132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.405231] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.406588] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.406792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.407142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdf3bd43-88e3-4369-bf28-f01528bed7f6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.407273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.407321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.407504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.407583] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdf3bd43-88e3-4369-bf28-f01528bed7f6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.907673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.907673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.912229] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdf3bd43-88e3-4369-bf28-f01528bed7f6 with status ACTIVE [ 737.912319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.912400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.912444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.912853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.912853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.912966] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.913082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.913217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.913326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.913405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.913586] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.913676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.913736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.913870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.913943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.914127] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdf3bd43-88e3-4369-bf28-f01528bed7f6 is going to be updated. [ 737.934740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.934901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.934999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.935201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.935337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.935496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdf3bd43-88e3-4369-bf28-f01528bed7f6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.040468] env[66919]: INFO networking_nsxv3.common.synchronization [req-081c7749-3a89-4da5-af9e-b076a2a3eea3 req-434a0636-3c18-497b-b5e0-44c461767f94 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 738.040468] env[66919]: INFO networking_nsxv3.common.synchronization [req-081c7749-3a89-4da5-af9e-b076a2a3eea3 req-434a0636-3c18-497b-b5e0-44c461767f94 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 738.040468] env[66919]: INFO networking_nsxv3.common.synchronization [req-081c7749-3a89-4da5-af9e-b076a2a3eea3 req-434a0636-3c18-497b-b5e0-44c461767f94 service nova] Enqueued Resource ID: 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 with Priority: HIGHEST for action port [ 738.040468] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 738.040468] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 738.040638] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 with Priority: HIGHEST for action port [ 738.040813] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.040932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.041157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.041448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.041536] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.042394] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.042512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.042579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.042745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.042894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.042990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.043064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.043204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.043287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.043379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.044490] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.044596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.044655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.045427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.045427] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25479d5f-215c-4d3a-bc90-2062f1c8c6e4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.547297] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.547430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.547627] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.548585] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 with status ACTIVE [ 738.548775] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.548910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.548978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.549204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.549294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.549467] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.549563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.549624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.549771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.549845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.551624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.551780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.551850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.552023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.552109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.552197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25479d5f-215c-4d3a-bc90-2062f1c8c6e4 is going to be updated. [ 738.578822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.578986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.579045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.579265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.579405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.579563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25479d5f-215c-4d3a-bc90-2062f1c8c6e4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.606147] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c in Status: SUCCESS [ 738.606384] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c deletion is rescheduled due to dependency. [ 738.606507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.054717] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.293221] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 739.293557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.293828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.294139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.294347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.294471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.294539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.294716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.294808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.294937] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.557185] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.557345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.557415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.557638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.557730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.557825] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be created. [ 739.580588] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.580733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.580802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.581016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.581204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.591300] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: UNINITIALIZED for 2s [ 739.798030] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.299345] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.567342] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cf9d3b8-d7e9-41f2-8659-6cb55f95f96d req-630b1bee-853d-4acf-8a78-910f661a3ec4 tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 740.567342] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 740.567342] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.567342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.570075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.570075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.570235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.570235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.570336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.570458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.570865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.571055] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.804744] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.804744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.804744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.804744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.804744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.804744] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 740.841774] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.841774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.841774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.841774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.841774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.850373] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 740.944088] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.947120] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.947120] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.953735] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.953735] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.953735] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.953735] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.953735] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.953735] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.953735] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.984025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.984025] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.984025] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.984025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.984025] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-910694f3-a19c-496d-abe4-889021235516 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.984025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.984025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.984025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.984025] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('910694f3-a19c-496d-abe4-889021235516',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.073815] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.147752] env[66919]: INFO networking_nsxv3.common.synchronization [req-345edcea-4661-4042-bbc4-5b148ae2ed2f req-8e0865b5-46f4-4058-8a5c-9ef8304a829a tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 741.148283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 741.148584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.148734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.148779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.149112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.149192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.149273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.149273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.149418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.149490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.149583] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.490774] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.491451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.491451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.491451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.491535] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.491683] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 910694f3-a19c-496d-abe4-889021235516 not found, creating... [ 741.491945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.492113] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.492225] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.492478] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.492629] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.493101] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.493287] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.493404] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.493746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.494038] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.494248] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 910694f3-a19c-496d-abe4-889021235516 is going to be created. [ 741.514572] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.514777] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.514965] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.515361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.515653] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.515932] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.578768] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.602161] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 741.602774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.602774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.603127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.603376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.603529] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.603621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.603808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.603900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.604019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.604163] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.651818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.652098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.652151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.652349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.652468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.652658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.652758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.652822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.652995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.653158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.653309] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 741.701860] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.702076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.702076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.702360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.702514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.712874] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 742.084168] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.084339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.084414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.084633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.084749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.084891] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 742.106968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.107175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.107228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.107437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.107599] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.107696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.108052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.108052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.108052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.108191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.108308] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.108406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.108468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.108613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.108750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.108839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.108911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.109504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.109762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.109866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.109959] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.116065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.116065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.116065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.116065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.116065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.126745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 742.183980] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cf9d3b8-d7e9-41f2-8659-6cb55f95f96d req-8b5b7b21-dda6-49aa-983a-ec692493d2a2 service nova] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_rules [ 742.184188] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cf9d3b8-d7e9-41f2-8659-6cb55f95f96d req-8b5b7b21-dda6-49aa-983a-ec692493d2a2 service nova] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 742.184382] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cf9d3b8-d7e9-41f2-8659-6cb55f95f96d req-8b5b7b21-dda6-49aa-983a-ec692493d2a2 service nova] Enqueued Resource ID: 910694f3-a19c-496d-abe4-889021235516 with Priority: HIGHEST for action port [ 742.184618] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_rules [ 742.184786] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 742.184840] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 910694f3-a19c-496d-abe4-889021235516 with Priority: HIGHEST for action port [ 742.185743] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.185880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.185928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.186144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.186228] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.187161] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.187265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.187491] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-910694f3-a19c-496d-abe4-889021235516 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.187578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.187614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.187784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.187928] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('910694f3-a19c-496d-abe4-889021235516',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.612254] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8993b03-159d-4cb8-a490-873c724e7d28: rpc.has_security_group_logging(os_id): False [ 742.631283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.631283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.631445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.631564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.631656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.631871] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.631967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.632048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.632295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.632295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.632564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.632564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.632665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.632716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.632788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.632960] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.633182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.633343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.633656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.633656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.633743] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be created. [ 742.690025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.690372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.690372] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 910694f3-a19c-496d-abe4-889021235516 with status ACTIVE [ 742.690569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.690679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.690744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.690990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.691363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.691423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.691583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.691667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.691828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.691918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.691994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.692385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.692385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.692385] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 910694f3-a19c-496d-abe4-889021235516 is going to be updated. [ 742.698637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.698637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.698637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.698637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.698882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.714196] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 742.725095] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.725095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.725095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.725095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.725095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.725095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-910694f3-a19c-496d-abe4-889021235516" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.863116] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 742.863423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.863606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.863826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.864025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.864144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.864206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.864361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.864466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.864517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.864607] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.928215] env[66919]: INFO networking_nsxv3.common.synchronization [None req-0ae59355-7ec2-4d3b-a43a-00ad1eb94f4d None None] Enqueued Resource ID: 7ad68758-e829-4bb1-9102-a2152e588cc6 with Priority: HIGHEST for action port [ 742.929364] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ad68758-e829-4bb1-9102-a2152e588cc6 with Priority: HIGHEST for action port [ 742.929364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ad68758-e829-4bb1-9102-a2152e588cc6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.929364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ad68758-e829-4bb1-9102-a2152e588cc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.929719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ad68758-e829-4bb1-9102-a2152e588cc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.929719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ad68758-e829-4bb1-9102-a2152e588cc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.929830] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ad68758-e829-4bb1-9102-a2152e588cc6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.368169] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.368169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.368169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.368390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.368567] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.369360] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.369360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.369650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.369650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.369716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.369749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.369882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.369942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.370019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.370095] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.432902] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ad68758-e829-4bb1-9102-a2152e588cc6 [ 743.433118] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.433366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.433366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.433532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.433622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.433713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ad68758-e829-4bb1-9102-a2152e588cc6 already deleted. [ 743.433789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ad68758-e829-4bb1-9102-a2152e588cc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.441283] env[66919]: INFO networking_nsxv3.common.synchronization [req-03014538-e4d5-48f8-92b6-702a8d2af2f1 req-de5b7eee-e553-463a-8353-9846e585a781 tempest-ServersAdminNegativeTestJSON-847607459 tempest-ServersAdminNegativeTestJSON-847607459-project-member] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 743.441283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 743.441283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.441283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.441283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.443169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.443580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.443580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.443580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.443776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.443776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.443843] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.730999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 743.730999] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 743.730999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.873093] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 743.894799] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.896029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.896124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.897754] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.897754] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.897754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.898327] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.898327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.898327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.898327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.898327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.898327] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 743.947523] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.947692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.947747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.948028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.948125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.948322] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.948418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.948479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.948628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.948701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.948781] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 already deleted. [ 743.948872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.963650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.963942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.963942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.964146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.964250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.980045] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 744.077353] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.077968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.077968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.078507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.078908] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.080390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.080390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.080390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.080390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.080637] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.080756] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 744.080861] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 744.080964] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 744.081081] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 744.081182] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 744.082248] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 744.105865] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 744.106068] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 744.106167] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 744.106708] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.106708] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-1aca56d3-5bca-47cb-83f4-ec5722976421 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.106960] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.106960] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.107284] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.107419] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aca56d3-5bca-47cb-83f4-ec5722976421',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.136219] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 744.136426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.137065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.137580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.137843] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.137993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.139511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.139511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.139511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.139511] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.611728] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.611971] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.612180] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.612548] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.612768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.612998] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 1aca56d3-5bca-47cb-83f4-ec5722976421 not found, creating... [ 744.613417] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.613660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.613840] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.614179] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.614380] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.614693] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.614852] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.614963] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.615242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.615467] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.615546] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 1aca56d3-5bca-47cb-83f4-ec5722976421 is going to be created. [ 744.635624] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.636011] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.636011] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.636979] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.636979] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.636979] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.641408] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.731071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 744.731071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.016639] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b922a89e-5bc1-489d-80fa-3b4e69f066ea None None] Enqueued Resource ID: e27d18ff-a601-481b-804f-d5ba82983d02 with Priority: HIGHEST for action port [ 745.017244] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e27d18ff-a601-481b-804f-d5ba82983d02 with Priority: HIGHEST for action port [ 745.017539] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e27d18ff-a601-481b-804f-d5ba82983d02 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.017653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e27d18ff-a601-481b-804f-d5ba82983d02" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.017716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e27d18ff-a601-481b-804f-d5ba82983d02" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.018142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e27d18ff-a601-481b-804f-d5ba82983d02" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.018278] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e27d18ff-a601-481b-804f-d5ba82983d02',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.143466] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.387526] env[66919]: INFO networking_nsxv3.common.synchronization [req-03014538-e4d5-48f8-92b6-702a8d2af2f1 req-e8262b3b-dee0-45e3-9546-21b71ad3d8ae service nova] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_rules [ 745.387735] env[66919]: INFO networking_nsxv3.common.synchronization [req-03014538-e4d5-48f8-92b6-702a8d2af2f1 req-e8262b3b-dee0-45e3-9546-21b71ad3d8ae service nova] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 745.387789] env[66919]: INFO networking_nsxv3.common.synchronization [req-03014538-e4d5-48f8-92b6-702a8d2af2f1 req-e8262b3b-dee0-45e3-9546-21b71ad3d8ae service nova] Enqueued Resource ID: 1aca56d3-5bca-47cb-83f4-ec5722976421 with Priority: HIGHEST for action port [ 745.391026] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_rules [ 745.391026] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 745.391026] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1aca56d3-5bca-47cb-83f4-ec5722976421 with Priority: HIGHEST for action port [ 745.391026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.391026] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.391026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.391026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.391026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.391626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.391626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.391626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.391626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.391626] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.392231] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1aca56d3-5bca-47cb-83f4-ec5722976421 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.392339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.392386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.392528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.393586] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1aca56d3-5bca-47cb-83f4-ec5722976421',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.521393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e27d18ff-a601-481b-804f-d5ba82983d02 [ 745.521614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.521742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.521826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.522056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.522146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.522237] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e27d18ff-a601-481b-804f-d5ba82983d02 already deleted. [ 745.523543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e27d18ff-a601-481b-804f-d5ba82983d02" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.625250] env[66919]: INFO networking_nsxv3.common.synchronization [None req-139c5989-b58d-4b13-9a73-2ffae6b3c6b7 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 745.625800] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 745.626144] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.626232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.626301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.626588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.626628] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.646556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.646774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.646946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.647170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.647210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.647292] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 745.683841] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.683841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.683841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.683841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.683841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.692464] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 745.729495] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f4737848-e08f-435f-a40c-6b46bb7d9105 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 745.730628] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 745.730628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.730628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.895621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.895948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.896089] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.897092] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1aca56d3-5bca-47cb-83f4-ec5722976421 with status ACTIVE [ 745.897325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.897443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.897475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.897685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.897776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.897983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.898091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.898152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.898395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.898395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.898564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.900391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.900467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.900643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.900871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.903973] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1aca56d3-5bca-47cb-83f4-ec5722976421 is going to be updated. [ 745.928294] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.928294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.928294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.928294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.928294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.929079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1aca56d3-5bca-47cb-83f4-ec5722976421" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.998292] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 745.998292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.152846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.152846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.152846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.152846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.152846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.152846] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 already deleted. [ 746.153488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.153488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.153488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.153488] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.406759] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.451866] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c2a15468-3985-4197-b732-26ba03e0ed9f tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: 8098f97a-6595-404b-b155-e66f026c096f with Priority: HIGHEST for action security_group_rules [ 746.452374] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8098f97a-6595-404b-b155-e66f026c096f with Priority: HIGHEST for action security_group_rules [ 746.452678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8098f97a-6595-404b-b155-e66f026c096f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.452798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.453503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.453798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.453902] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8098f97a-6595-404b-b155-e66f026c096f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.573309] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e6188ab1-1dd7-46e6-ae8c-7eb24b0cf913 tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: 8098f97a-6595-404b-b155-e66f026c096f with Priority: HIGHEST for action security_group_rules [ 746.573848] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8098f97a-6595-404b-b155-e66f026c096f with Priority: HIGHEST for action security_group_rules [ 746.574349] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8098f97a-6595-404b-b155-e66f026c096f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.574349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.675198] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.675354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.675419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.675632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.675725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.675931] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 already deleted. [ 746.676086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.909496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.909845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.909845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.910127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.910233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.910339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be created. [ 746.933882] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.934394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.934578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.945358] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: UNINITIALIZED for 2s [ 746.974501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.974812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.974981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.975238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.975333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.975437] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8098f97a-6595-404b-b155-e66f026c096f already deleted. [ 746.975526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.975688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.975850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.975941] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8098f97a-6595-404b-b155-e66f026c096f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.500087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.500087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.500087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.500087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.500087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.500087] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8098f97a-6595-404b-b155-e66f026c096f already deleted. [ 747.500708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8098f97a-6595-404b-b155-e66f026c096f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.709293] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 747.709517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.709707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.710775] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.710775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.711074] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.214413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.214841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.214841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.214927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.215112] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.215391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.215391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.215537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.215717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.215815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.215974] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.216082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.216148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.216286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.216424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.216546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.216654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.216819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.216929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.216967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.217062] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.721508] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 760a77bb-57f0-44e3-b609-b74fb3c191fd: rpc.has_security_group_logging(os_id): False [ 748.740992] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.741158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.741222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.741425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.741535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.741733] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.741835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.741897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.742104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.742187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.742381] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.742476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.742537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.742680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.742754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.742936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.749155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.749316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.749540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.749636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.749741] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 748.819984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.820228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.820228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.820426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.820604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.834477] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 748.956421] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 748.956646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.956820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.957084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.957284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.957400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.957464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.957636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.957782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.957885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.957995] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.248793] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6b57844-5ee3-4875-bc1e-a1d234ef2f42 req-4cca34ea-a477-4a66-8810-0bfda345c405 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 749.249638] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 749.249741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.249879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.249944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.250461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.250934] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.250934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.250934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.251109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.251109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.251167] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.460408] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.460582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.460633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.460858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.461025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.461165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.462042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.462042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.462042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.462042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.462042] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.462254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.462254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.462343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.462611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.462713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.462773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.462915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.462994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.463090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.463179] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.757868] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.967355] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c800be9-5a1f-4e7d-acfb-e24947683dc0: rpc.has_security_group_logging(os_id): False [ 749.987125] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.987332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.987414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.987638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.987729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.987952] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.988067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.988132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.988318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.988406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.988593] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.988690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.988750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.988900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.988981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.989254] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.989828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.989828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.989828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.989828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.990129] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be created. [ 750.058402] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.058573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.058624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.058839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.059034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.073307] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 750.259522] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.766571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.766765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.767567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.767567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.767567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.767567] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 750.799919] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.799919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.799919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.799919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.799919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.811783] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 750.849966] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 750.850205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.085685] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 752.086954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.822306] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 752.822550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.250845] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 754.251604] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 754.860714] env[66919]: INFO networking_nsxv3.common.synchronization [req-f0d48510-ef5f-4e64-91c9-c0bb0f629fcd req-2a173aa8-b89c-4aa3-a181-c0fb6a8ed475 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 754.862411] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 754.864570] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.864758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.864898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.865665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.865665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.865862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.865994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.867034] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.997959] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ca9c852d-51e1-4fad-aed2-ea31777ed4b2 None None] Enqueued Resource ID: 077ff654-9644-4448-ace2-4715bec8a606 with Priority: HIGHEST for action port [ 754.999322] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 077ff654-9644-4448-ace2-4715bec8a606 with Priority: HIGHEST for action port [ 755.001675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-077ff654-9644-4448-ace2-4715bec8a606 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.001675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-077ff654-9644-4448-ace2-4715bec8a606" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.001675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-077ff654-9644-4448-ace2-4715bec8a606" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.001978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-077ff654-9644-4448-ace2-4715bec8a606" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.001978] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('077ff654-9644-4448-ace2-4715bec8a606',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.371481] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.374632] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.374632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.374632] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 755.408811] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.409224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.409368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.409598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.410012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.420629] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 755.505668] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 077ff654-9644-4448-ace2-4715bec8a606 [ 755.505668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.505668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.505668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.505668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.505668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.505668] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:077ff654-9644-4448-ace2-4715bec8a606 already deleted. [ 755.505668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-077ff654-9644-4448-ace2-4715bec8a606" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.431937] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 757.432504] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 deletion is rescheduled due to dependency. [ 757.432504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.757468] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c9571fd9-5b6d-45be-ad66-4fa1d11337b9 None None] Enqueued Resource ID: 6d77ccbc-6ce6-4d81-8042-81bed13d45ba with Priority: HIGHEST for action port [ 757.758904] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d77ccbc-6ce6-4d81-8042-81bed13d45ba with Priority: HIGHEST for action port [ 757.763645] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d77ccbc-6ce6-4d81-8042-81bed13d45ba taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.763645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d77ccbc-6ce6-4d81-8042-81bed13d45ba" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.763645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d77ccbc-6ce6-4d81-8042-81bed13d45ba" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.763645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d77ccbc-6ce6-4d81-8042-81bed13d45ba" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.763645] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d77ccbc-6ce6-4d81-8042-81bed13d45ba',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.196901] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bbbc80a-070b-48cd-a27b-d8534aab4a1f req-3951b6dc-4f0d-4709-b218-b451cb5b8c06 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 758.197553] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 758.197858] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.198158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.198158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.199105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.199105] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.199105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.199105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.199359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.199359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.199359] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.264016] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d77ccbc-6ce6-4d81-8042-81bed13d45ba [ 758.268319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.268319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.268319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.268319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.268319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.268319] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d77ccbc-6ce6-4d81-8042-81bed13d45ba already deleted. [ 758.268319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d77ccbc-6ce6-4d81-8042-81bed13d45ba" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.674390] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.675555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-904" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.675555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-904" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.675673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-904" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.675923] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.676086] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.676197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.676409] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.676564] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.677176] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.677176] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.677176] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.677176] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.677472] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.677472] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.677472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.697573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.697742] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.697864] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.698049] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-904" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.698366] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-1a46076f-6e64-41db-a480-bf1ecabe445f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.698615] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.698850] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.699269] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.699464] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a46076f-6e64-41db-a480-bf1ecabe445f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.702564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.702564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.702564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.702564] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 already deleted. [ 758.703037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.201962] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.202271] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.202450] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.202792] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.202948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.203164] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 1a46076f-6e64-41db-a480-bf1ecabe445f not found, creating... [ 759.203489] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.203682] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.203870] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.204143] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.204320] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.204751] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.204963] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.205115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.205417] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.205579] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.205751] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 1a46076f-6e64-41db-a480-bf1ecabe445f is going to be created. [ 759.240090] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.240367] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.240489] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.240778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.241071] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.241276] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.324087] env[66919]: INFO networking_nsxv3.common.synchronization [req-93b3876d-298b-44e0-a298-d0b005b35ad0 req-828391b1-939e-40ab-9050-d8fe86bf034b tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 759.325063] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGHEST for action security_group_members [ 759.325660] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.325660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.325660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.326063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.326318] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.326503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.326638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.326854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.327012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.327225] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.825503] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 759.825503] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:1 started [ 759.829105] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.829248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.829318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.829529] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.829615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.829799] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.829893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.830040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.830227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.830330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.830448] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 is going to be updated. [ 759.859279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.859418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.859493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.860216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.860389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.870072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: IN_PROGRESS for 2s [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bbbc80a-070b-48cd-a27b-d8534aab4a1f req-92b8fca1-1ce0-48ab-9bdf-eed9c39e7b0a service nova] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bbbc80a-070b-48cd-a27b-d8534aab4a1f req-92b8fca1-1ce0-48ab-9bdf-eed9c39e7b0a service nova] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bbbc80a-070b-48cd-a27b-d8534aab4a1f req-92b8fca1-1ce0-48ab-9bdf-eed9c39e7b0a service nova] Enqueued Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 759.994283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 759.994283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.995540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.995615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.995868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.995955] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.996903] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.997067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.997108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.997282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.997436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.997528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.997587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.997757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.997873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.997929] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.998751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a46076f-6e64-41db-a480-bf1ecabe445f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.002612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.002612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.002612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.002612] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a46076f-6e64-41db-a480-bf1ecabe445f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.504987] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.506106] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.506207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.506776] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a46076f-6e64-41db-a480-bf1ecabe445f with status ACTIVE [ 760.506776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.507105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.507105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.507315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.507315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.507425] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.507474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.507537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.507983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.507983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.507983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.508151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.508151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.508260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.508331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.508421] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a46076f-6e64-41db-a480-bf1ecabe445f is going to be updated. [ 760.529875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.530066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.530590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.530590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.530590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.530812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.007346] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.512294] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.512294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.512294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.512294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.512294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.512294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be created. [ 761.526028] env[66919]: INFO networking_nsxv3.common.synchronization [req-08b6664f-71f5-4e8b-ba5b-d4b7c0e9345d req-26fb730e-e0aa-48c1-ad78-e0f21f391fca tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 761.526028] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 761.526028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.526028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.526028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.526028] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.537010] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.537010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.537010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.538031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.538031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.554135] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: UNINITIALIZED for 2s [ 761.882424] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 in Status: SUCCESS [ 761.882424] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 deletion is rescheduled due to dependency. [ 761.882424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.884559] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.884792] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.884937] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.885290] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.886180] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.886180] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.886180] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.886180] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.886379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.886553] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.886693] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 761.886831] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 761.886971] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 761.887098] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 761.887861] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 761.887861] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 761.906209] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 761.906378] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 761.906511] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 761.906678] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.907176] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.907318] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.907409] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.907829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.908017] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.027863] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.028312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.028312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.028422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.028422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.028609] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.028708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.028760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.028924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.029061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.029095] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 already deleted. [ 762.029377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.410824] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.411070] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.411879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.411879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.411879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.411879] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 not found, creating... [ 762.412206] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.412206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.412302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.413147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.413147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.413147] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.413147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.413147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.413410] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.413497] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.413633] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 is going to be created. [ 762.435556] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.435832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.435943] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.436229] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.436452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.437148] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [req-08b6664f-71f5-4e8b-ba5b-d4b7c0e9345d req-8ddecf68-dc46-4783-b6bb-420de46d0055 service nova] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [req-08b6664f-71f5-4e8b-ba5b-d4b7c0e9345d req-8ddecf68-dc46-4783-b6bb-420de46d0055 service nova] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [req-08b6664f-71f5-4e8b-ba5b-d4b7c0e9345d req-8ddecf68-dc46-4783-b6bb-420de46d0055 service nova] Enqueued Resource ID: fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 with Priority: HIGHEST for action port [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 763.182172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 with Priority: HIGHEST for action port [ 763.182172] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.182172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.182172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.183168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.183266] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.185479] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.185616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.185687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.185882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.186052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.186151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.186213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.186381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.186508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.186610] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.187836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.187952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.188247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.188247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.188247] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.565071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 763.565311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.565550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.565741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.565947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.566143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.566234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.566384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.566461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.566549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.566635] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.689791] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.689791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.692513] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 with status ACTIVE [ 763.692513] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.692513] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.692513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.692513] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.692899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.692899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.692899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.692899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.692899] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58 is going to be updated. [ 763.694037] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.720287] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.720433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.721040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.721040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.721040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.721273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe1d1a1d-c322-4ee2-8da9-4a0f1d43cf58" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.069807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.069807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.069807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.069807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.070071] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.070071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.070211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.070404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.070509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.070617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.070792] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.070908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.070984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.071167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.071323] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.072043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.072043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.072043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.072043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.072043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.072043] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.196925] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.573861] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc4eed96-db0f-482c-9dd1-a49874fad4b1: rpc.has_security_group_logging(os_id): False [ 764.591665] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.591834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.591898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.592112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.592207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.592396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.592506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.592561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.592700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.592776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.592961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.593069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.593127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.593266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.593339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.593533] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.593630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.593681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.593809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.593888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.593973] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be created. [ 764.654017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.654175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.654259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.654987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.654987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.671180] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 764.699694] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.699790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.699823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.700070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.700169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.700250] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be created. [ 764.754474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.754718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.754718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.755276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.755617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.780960] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: UNINITIALIZED for 2s [ 766.685171] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 766.685442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.792151] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 766.792371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.792533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.792827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.793037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.793155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.793232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.793395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.793476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.793562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.793672] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.297325] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.799225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b46dc5c-dcd7-49a6-a2b6-31024aac0805: rpc.has_security_group_logging(os_id): False [ 767.827964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.828127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.828213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.828416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.828509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.828748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.828843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.828916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.829287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.829287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.829287] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be created. [ 767.889826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.889963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.889963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.890926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.890926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.900586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 768.182182] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 768.182302] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 769.920088] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 769.920377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.218141] env[66919]: INFO networking_nsxv3.common.synchronization [req-f64d2336-4d3d-41a7-ac02-ae2cbaa28bfc req-f00579e6-202d-4b3d-a935-04dab19cd808 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 770.218702] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 770.219181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.221602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.221674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.221881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.222074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.222174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.222239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.222388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.222468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.222560] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.611075] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.611175] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.611316] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.611677] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.612452] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.612452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.612452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.612643] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.612735] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.612934] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.614243] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.614243] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.614243] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.614243] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.614243] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.614243] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.642020] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.642020] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.642020] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.642020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.642020] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.642020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.642020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.642020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.642020] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.728241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.728450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.728502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.728694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.728785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.728969] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.729090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.729168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.729319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.729395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.729482] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 770.757856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.758017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.758091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.758311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.758461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.768926] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 771.145591] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.145922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.145922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.146201] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.146383] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.146535] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf not found, creating... [ 771.146849] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.147054] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.147126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.147347] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.147481] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.147804] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.148000] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.148147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.148447] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.148600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.148775] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf is going to be created. [ 771.172683] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.172885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.173016] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.173293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.173509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.173720] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.914775] env[66919]: INFO networking_nsxv3.common.synchronization [req-f64d2336-4d3d-41a7-ac02-ae2cbaa28bfc req-2b8ed810-2c8c-43e6-8fe8-13c3108ed366 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 771.914775] env[66919]: INFO networking_nsxv3.common.synchronization [req-f64d2336-4d3d-41a7-ac02-ae2cbaa28bfc req-2b8ed810-2c8c-43e6-8fe8-13c3108ed366 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 771.914924] env[66919]: INFO networking_nsxv3.common.synchronization [req-f64d2336-4d3d-41a7-ac02-ae2cbaa28bfc req-2b8ed810-2c8c-43e6-8fe8-13c3108ed366 service nova] Enqueued Resource ID: d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf with Priority: HIGHEST for action port [ 771.915476] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 771.915614] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 771.915710] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf with Priority: HIGHEST for action port [ 771.916073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.916219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.916281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.916488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.916568] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.918075] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.918181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.918369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.918468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.918587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.918727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.918807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.420552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.420953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.420953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf with status ACTIVE [ 772.421035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.421133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.421201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.421409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.421496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.421921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.422083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.422151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.422311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.422390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.422852] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.422964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.423040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.423190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.423266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.423350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf is going to be updated. [ 772.449599] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.449803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.449927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.450275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.450503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.450760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9231875-bb9c-48c8-a9b8-1b6aa9cbafcf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.781467] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 772.781689] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 772.781807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.781978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.782213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.782393] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.782510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.782573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.782732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.782815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.782909] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.998768] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f9cd01b-1f51-4236-9b2a-cf402ebde223 req-225b98c8-3a3c-43e1-89ca-78aa340c8f70 tempest-ServerRescueTestJSON-397859255 tempest-ServerRescueTestJSON-397859255-project-member] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 772.999472] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 772.999802] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.999802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.999802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.999984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.000145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.000243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.000297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.000441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.000541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.000627] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.287539] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.349528] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.349723] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.349849] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.350194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.350463] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.350614] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.350724] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.350935] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.351100] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.351297] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.351400] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 773.351500] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 773.351600] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 773.351699] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 773.351796] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 773.351919] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 773.373293] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 773.373457] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 773.373624] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 773.373809] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.374131] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.374299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.374412] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.375071] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.375071] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1ec495-b3dc-4f8c-a60d-a2c753d134ce',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.503087] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.789750] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.877349] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.880019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port ea1ec495-b3dc-4f8c-a60d-a2c753d134ce not found, creating... [ 773.880019] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.880019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.880754] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.881092] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.881356] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.881669] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.881983] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.882227] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: ea1ec495-b3dc-4f8c-a60d-a2c753d134ce is going to be created. [ 773.906288] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.906701] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.906975] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.907445] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.907843] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.908203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.006104] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.293516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.293700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.293744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.293957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.294064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.294163] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 774.323432] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.323613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.323657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.323833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.323978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.332426] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 774.510372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.510650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.510650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.510850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.510948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.511057] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 774.541135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.542640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.542771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.543137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.543382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.554172] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 774.645613] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f9cd01b-1f51-4236-9b2a-cf402ebde223 req-c58dad3e-3aaf-44d8-99f5-bd0d2bfe6442 service nova] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_rules [ 774.645789] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f9cd01b-1f51-4236-9b2a-cf402ebde223 req-c58dad3e-3aaf-44d8-99f5-bd0d2bfe6442 service nova] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 774.646329] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f9cd01b-1f51-4236-9b2a-cf402ebde223 req-c58dad3e-3aaf-44d8-99f5-bd0d2bfe6442 service nova] Enqueued Resource ID: ea1ec495-b3dc-4f8c-a60d-a2c753d134ce with Priority: HIGHEST for action port [ 774.646614] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_rules [ 774.646760] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 774.646838] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea1ec495-b3dc-4f8c-a60d-a2c753d134ce with Priority: HIGHEST for action port [ 774.647206] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.647332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.647332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.647496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.647565] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.649921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.650020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.650168] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.650264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.650315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.651172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.651172] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea1ec495-b3dc-4f8c-a60d-a2c753d134ce',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.154525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.154679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.154814] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea1ec495-b3dc-4f8c-a60d-a2c753d134ce with status ACTIVE [ 775.155894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.155894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.156856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.156856] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea1ec495-b3dc-4f8c-a60d-a2c753d134ce is going to be updated. [ 775.185229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.185434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.185434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.185676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.185845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.186046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea1ec495-b3dc-4f8c-a60d-a2c753d134ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.857166] env[66919]: INFO networking_nsxv3.common.synchronization [req-e8f62694-959a-4d31-b3d7-e7bc5cd8466f req-22f30d74-3c92-4c3e-864b-c73be0017f89 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 775.857166] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 775.858078] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.858460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.858698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.859058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.859341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.859562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.859712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.860750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.860750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.860750] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.251605] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.251823] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.251910] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.252259] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.252489] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.252633] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.252742] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.252948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.253099] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.253296] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.253397] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 776.253499] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 776.253597] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 776.253696] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 776.253801] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 776.253914] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 776.276025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 776.276159] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 776.276205] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 776.276391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.276822] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-65d3a7c2-e8f9-499b-8753-2638bba591a6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.277020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.277172] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.277539] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.277703] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65d3a7c2-e8f9-499b-8753-2638bba591a6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.343720] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 776.344036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.344238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.344495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.344747] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.344890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.344961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.345181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.345270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.345383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.345485] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.362738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.362915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.362999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.363232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.363329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.363522] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.363631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.363694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.363844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.363920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.364009] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 already deleted. [ 776.364093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.571415] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 776.571700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.571940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.572249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.572501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.572667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.572771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.573013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.573165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.573318] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.781733] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.781980] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.782118] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.782430] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.782636] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.782878] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 65d3a7c2-e8f9-499b-8753-2638bba591a6 not found, creating... [ 776.783269] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.783475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.783592] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.783824] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.783957] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.784260] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.784411] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.784521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.784767] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.784908] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.785055] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 65d3a7c2-e8f9-499b-8753-2638bba591a6 is going to be created. [ 776.819553] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.819860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.819860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.820147] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.820355] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.820530] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.847976] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.848184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.848254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.848473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.848642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.848741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.848889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.849066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.849160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.849248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.849400] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.849495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.849556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.849759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.849905] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.849999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.850073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.850226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.850302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.850432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.850581] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.079584] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.352732] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5: rpc.has_security_group_logging(os_id): False [ 777.376166] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.376166] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.376166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.376527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.376527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.376527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.376618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.376618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.376963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.377115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.377727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.378090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.378868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.378868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 777.465770] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.465770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.465770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.465770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.466308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.479671] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 777.558569] env[66919]: INFO networking_nsxv3.common.synchronization [req-e8f62694-959a-4d31-b3d7-e7bc5cd8466f req-7701ce62-cc2c-4011-8222-85a66ce75422 service nova] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 777.558748] env[66919]: INFO networking_nsxv3.common.synchronization [req-e8f62694-959a-4d31-b3d7-e7bc5cd8466f req-7701ce62-cc2c-4011-8222-85a66ce75422 service nova] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 777.562021] env[66919]: INFO networking_nsxv3.common.synchronization [req-e8f62694-959a-4d31-b3d7-e7bc5cd8466f req-7701ce62-cc2c-4011-8222-85a66ce75422 service nova] Enqueued Resource ID: 65d3a7c2-e8f9-499b-8753-2638bba591a6 with Priority: HIGHEST for action port [ 777.562021] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 777.562021] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 777.562021] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d3a7c2-e8f9-499b-8753-2638bba591a6 with Priority: HIGHEST for action port [ 777.562021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.562021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.562021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.562021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.562021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.562021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.563737] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-65d3a7c2-e8f9-499b-8753-2638bba591a6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.563893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.563893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.564071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.564799] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65d3a7c2-e8f9-499b-8753-2638bba591a6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.582800] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.066312] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.066456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.066701] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.069073] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65d3a7c2-e8f9-499b-8753-2638bba591a6 with status ACTIVE [ 778.069073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.069073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.069073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.069073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.071734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.071734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.071734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.071899] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65d3a7c2-e8f9-499b-8753-2638bba591a6 is going to be updated. [ 778.085561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.086058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.086058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.087079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.088282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.088282] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 778.097616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.097878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.097878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.098055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.098192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.098350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65d3a7c2-e8f9-499b-8753-2638bba591a6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.119292] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.119501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.123276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.123531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.123689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.136176] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 778.448987] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 778.449252] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 778.450325] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 778.450325] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 778.450512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.450512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.450593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.450867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.451068] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.451198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.451309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.451461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.451553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.451646] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.452645] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.452703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.452780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.453026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.453214] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.453329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.453395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.453551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.454316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.454316] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.498718] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_rules [ 778.498895] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 778.499044] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 778.499201] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 778.499328] env[66919]: INFO networking_nsxv3.common.synchronization [req-c4364823-cb36-4896-9deb-b6e59203fbda req-4fde7d24-84be-47bb-8463-0332dfd4b862 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 778.500087] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_rules [ 778.500224] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 778.500501] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 778.500501] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 778.500501] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 778.500750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.500866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.500974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.501189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.501293] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.502129] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.502242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.502305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.502472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.502547] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.503219] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a46076f-6e64-41db-a480-bf1ecabe445f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.503319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.503385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.503527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.503592] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a46076f-6e64-41db-a480-bf1ecabe445f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.504259] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.504353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.505196] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.505196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.575238] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.955664] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.956845] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.005996] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.006170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.006350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a46076f-6e64-41db-a480-bf1ecabe445f with status ACTIVE [ 779.006563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.006640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.006681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.006963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.007069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.007244] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.007349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.007401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.007550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.007625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.007839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.007945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.008037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.008339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.008339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.008339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a46076f-6e64-41db-a480-bf1ecabe445f is going to be updated. [ 779.011862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.011995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.034516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.035053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.035180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.035436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.035749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.035975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.077290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.077514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.077514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.078794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.078794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.078794] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be created. [ 779.122034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.122034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.122034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.122648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.122648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.138388] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: UNINITIALIZED for 2s [ 779.459193] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.462077] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.493237] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 779.493452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.553072] env[66919]: INFO networking_nsxv3.common.synchronization [req-6b93ccc4-d0a5-4260-94d9-3160955ab17f req-554daf61-de2c-429f-aaa8-e91f3a2c97f8 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 779.553327] env[66919]: INFO networking_nsxv3.common.synchronization [req-6b93ccc4-d0a5-4260-94d9-3160955ab17f req-554daf61-de2c-429f-aaa8-e91f3a2c97f8 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 779.553795] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a with Priority: HIGHEST for action security_group_members [ 779.554228] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 779.554454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.554590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.555265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.555265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.605026] env[66919]: INFO networking_nsxv3.common.synchronization [req-6b93ccc4-d0a5-4260-94d9-3160955ab17f req-554daf61-de2c-429f-aaa8-e91f3a2c97f8 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 779.605026] env[66919]: INFO networking_nsxv3.common.synchronization [req-6b93ccc4-d0a5-4260-94d9-3160955ab17f req-554daf61-de2c-429f-aaa8-e91f3a2c97f8 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 779.605026] env[66919]: INFO networking_nsxv3.common.synchronization [req-6b93ccc4-d0a5-4260-94d9-3160955ab17f req-554daf61-de2c-429f-aaa8-e91f3a2c97f8 tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 779.605413] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_rules [ 779.605547] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 779.605642] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a46076f-6e64-41db-a480-bf1ecabe445f with Priority: HIGHEST for action port [ 779.607943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.608173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.608481] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.608614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.608857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a46076f-6e64-41db-a480-bf1ecabe445f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.609259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.609259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.609452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.609567] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a46076f-6e64-41db-a480-bf1ecabe445f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.963904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.964058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.964142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.964457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.964595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.964707] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a is going to be created. [ 779.966299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.966407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.966448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.966621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.966779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.966919] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 779.993575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.993819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.993928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.994264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.994523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.002944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.003121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.003179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.003393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.003546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.013634] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 780.014179] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a in Status: UNINITIALIZED for 2s [ 780.113266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a46076f-6e64-41db-a480-bf1ecabe445f with status ACTIVE [ 780.115420] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.115420] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.115420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.115786] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.115786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.115786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.115786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.115786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.115954] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a46076f-6e64-41db-a480-bf1ecabe445f is going to be updated. [ 780.138903] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.139235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.139235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.139366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.139490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.139634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a46076f-6e64-41db-a480-bf1ecabe445f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.144416] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 780.144416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.144416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.144653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.144776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.144912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.144970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.145198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.145287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.145698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.145698] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.647515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.647718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.647845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.648034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.648195] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.648291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.648353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.648542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.648607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.648679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.648853] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.648949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.649027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.649236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.649316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.649393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.649442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.649584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.649658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.649739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.649852] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.767858] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.767858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.767858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.767858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.767858] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.149163] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.150373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.150373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.150668] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.153654] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc0f601-8257-4527-8366-40ea56f5ccdd: rpc.has_security_group_logging(os_id): False [ 781.177586] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.177770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.177933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.178164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.178292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.178528] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.178670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.178714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.178878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.178950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.179220] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.179324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.179388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.180462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.180462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.180658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.180733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.180772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.180939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.181033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.181128] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 781.248482] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.248482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.248482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.248482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.248482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.259495] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 781.275560] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.653257] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.780107] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.027824] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a in Status: SUCCESS [ 782.028332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.028332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.028466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.028658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.028831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.028831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.029941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.030092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.031786] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.031786] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 782.031945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.031985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.033847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.033847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.033847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.033847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.033847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.033847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.034135] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.156719] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ef1b9b-e982-41f7-a4f6-a3caf8809311: rpc.has_security_group_logging(os_id): False [ 782.174150] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.174297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.174336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.174561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.174681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.174924] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.175034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.175097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.175252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.175324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.175410] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be created. [ 782.242385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.242569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.242624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.242833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.243032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.255682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 782.283046] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 782.283174] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 782.536275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.536577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.536577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.536690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.536795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.536967] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.537103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.537158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.537304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.537377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.537460] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a is going to be deleted. [ 782.538594] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.623030] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.623030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.623255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.623318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.623412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.623690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.623947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.624044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.624158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.624228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.624378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.624473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.624563] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.041761] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.130019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a already deleted. [ 783.130019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.130019] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.134457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.134866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.135359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.135633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.135923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.137812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.137812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.137812] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.207058] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.207058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.207058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.207058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.225314] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 783.226925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.228800] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 783.267434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.267434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.267434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.267434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.277545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.278859] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 783.279175] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 783.279533] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 783.295086] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 783.295320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.331763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.332521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.332521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.332521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.333572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.333978] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 783.386497] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-0732ac1c-c853-4b5a-b74a-44c309b8b90d tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 783.387365] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 783.387741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.387928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.388030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.388391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.388596] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.388739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.389305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.389572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.389703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.389849] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.407018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.407018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.407018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.407018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.407018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.407018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 783.480051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.480278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.480278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.481709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.481709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.481709] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:32. [ 783.481709] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'34fb8f28-1898-4b72-aa0e-58d3cd80323e', 'f224771b-3e74-478f-8e84-a05495ab099b', 'c5cd8d4c-0799-476c-99a4-61a972ef02e0', 'af39d9f2-2893-4829-94fc-ff7334ea19fd', '5c800be9-5a1f-4e7d-acfb-e24947683dc0', '4689714c-abe3-425f-b780-ee3049d244c0', 'b0b1967b-4591-4210-b122-446732ce3041', '6a3ab807-fc85-4c12-b831-97beee7da03a', '92110755-d0a0-45ce-81ab-f52b3527b07a', '54a8eb66-4aa1-440c-af86-e5e65121f69f', '8d45aa44-8e7c-48b8-b926-f1958506fc0b', '4a88ee71-4c82-4813-b129-b022cced6be1', '6f1467a0-dd7b-4e6d-b03a-fc9a8001a008', '79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb', 'dc4eed96-db0f-482c-9dd1-a49874fad4b1', '7c20e0ac-3cc6-4d82-99dc-7e144a069371', '760a77bb-57f0-44e3-b609-b74fb3c191fd', '2fc0f601-8257-4527-8366-40ea56f5ccdd', '7264374f-cfc2-4efe-a3e1-37e97b0370c2', '64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c', '2d1de849-c2e6-46e2-a774-597b77be599b', 'f8993b03-159d-4cb8-a490-873c724e7d28', '349962c6-3abc-4bf7-9059-df3d43836eb4', 'c38fec75-1824-4123-9a27-d70b3e15c2bc', '11de85e1-8fdb-4cd8-898c-db27313f960d', '25ae71be-f061-446d-96fb-cc2053e285fa', '126dbb86-4151-4c70-bb98-79a6ebd8d9c5', '1c70302e-70ac-434d-a62c-6cde4cb391fa', '872d14cf-31fb-44ed-a275-fe8a6bdf8512', '07ef1b9b-e982-41f7-a4f6-a3caf8809311', 'dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5', '4b46dc5c-dcd7-49a6-a2b6-31024aac0805'} {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 783.481709] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 783.506279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.506279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.506279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.506279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.506773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.506773] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 783.506773] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 783.506773] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 783.543323] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.545322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.545322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.545322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.545322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.545322] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 783.593492] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.593723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.593856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.595060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.595060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.600247] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.600247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.600247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.600454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.602160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.602531] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 783.602670] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 783.602766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 783.602879] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 783.603043] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/32 resources of Type:Security Group Rules [ 783.603181] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGH for action security_group_rules [ 783.603358] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGH for action security_group_rules [ 783.603423] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGH for action security_group_rules [ 783.603526] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGH for action security_group_rules [ 783.603642] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGH for action security_group_rules [ 783.603740] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGH for action security_group_rules [ 783.603819] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 783.603890] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGH for action security_group_rules [ 783.603953] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGH for action security_group_rules [ 783.604030] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGH for action security_group_rules [ 783.604156] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGH for action security_group_rules [ 783.604156] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGH for action security_group_rules [ 783.604247] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGH for action security_group_rules [ 783.604247] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGH for action security_group_rules [ 783.604327] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGH for action security_group_rules [ 783.604497] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGH for action security_group_rules [ 783.604603] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGH for action security_group_rules [ 783.604673] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGH for action security_group_rules [ 783.604791] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGH for action security_group_rules [ 783.604791] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGH for action security_group_rules [ 783.604889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.614764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 783.632646] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.640089] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.640276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.640348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.640569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.640662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.640931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.641046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.641125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.641302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.641381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.641471] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a already deleted. [ 783.641548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.894269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.894269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.894269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 already deleted. [ 783.894269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.953430] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.953630] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.953836] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.954807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.955292] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.955463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.955628] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.955911] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.956160] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.956408] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.956541] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.956706] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.956831] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.957295] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.957520] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.957630] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.982743] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.982916] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.985105] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.985105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.985105] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-5fa10332-8f6d-441c-9249-f0038b2c7934 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.985105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.985105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.985105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.985105] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa10332-8f6d-441c-9249-f0038b2c7934',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.136219] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a: rpc.has_security_group_logging(os_id): False [ 784.162619] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.162763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.162838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.163078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.163170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.163409] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.163539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.163583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.163733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.163808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.163895] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a is going to be created. [ 784.188458] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a], does not exist path=[/infra/domains/default/groups/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a]."\n}' [ 784.188619] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a [ 784.188694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 784.225777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.226194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.226194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.226291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.227180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.227570] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.227570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.228762] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.228762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.228762] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a is going to be created. [ 784.254842] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a], does not exist path=[/infra/domains/default/groups/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a [ 784.254842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.254842] env[66919]: Traceback (most recent call last): [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 784.254842] env[66919]: return func(*args, **kwargs) [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 784.254842] env[66919]: res.raise_for_status() [ 784.254842] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 784.254842] env[66919]: raise HTTPError(http_error_msg, response=self) [ 784.254842] env[66919]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a [ 784.254842] env[66919]: During handling of the above exception, another exception occurred: [ 784.254842] env[66919]: Traceback (most recent call last): [ 784.254842] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 784.254842] env[66919]: listener.cb(fileno) [ 784.254842] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 784.254842] env[66919]: result = function(*args, **kwargs) [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 784.254842] env[66919]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 784.254842] env[66919]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 784.254842] env[66919]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 784.254842] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 784.254842] env[66919]: res.raise_for_status() [ 784.254842] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 784.254842] env[66919]: raise HTTPError(http_error_msg, response=self) [ 784.254842] env[66919]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5ecfb0ec-9692-4bf2-8d90-e9a6fa2dbb4a [ 784.254842] env[66919]: Removing descriptor: 5 [ 784.268175] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 784.268457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.487345] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.487345] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.487345] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.487505] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.487630] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.488953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 5fa10332-8f6d-441c-9249-f0038b2c7934 not found, creating... [ 784.488953] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.488953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.488953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.488953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.488953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.488953] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.489463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.489463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.489463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.489463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.489681] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 5fa10332-8f6d-441c-9249-f0038b2c7934 is going to be created. [ 784.513896] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.513896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.513896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.513896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.513896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.513896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.307555] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-e62a1ef4-807e-4567-813b-f2c60edd9bec service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 785.308448] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-e62a1ef4-807e-4567-813b-f2c60edd9bec service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 785.308448] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-e62a1ef4-807e-4567-813b-f2c60edd9bec service nova] Enqueued Resource ID: 5fa10332-8f6d-441c-9249-f0038b2c7934 with Priority: HIGHEST for action port [ 785.308557] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 785.308687] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 785.308999] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fa10332-8f6d-441c-9249-f0038b2c7934 with Priority: HIGHEST for action port [ 785.308999] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e with Priority: HIGH for action security_group_rules [ 785.308999] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 with Priority: HIGH for action security_group_rules [ 785.309700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 785.309882] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGH for action security_group_rules [ 785.309992] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c with Priority: HIGH for action security_group_rules [ 785.310130] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 with Priority: HIGH for action security_group_rules [ 785.310206] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGH for action security_group_rules [ 785.310299] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGH for action security_group_rules [ 785.310641] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGH for action security_group_rules [ 785.310771] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 with Priority: HIGH for action security_group_rules [ 785.310870] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGH for action security_group_rules [ 785.310997] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a88ee71-4c82-4813-b129-b022cced6be1 with Priority: HIGH for action security_group_rules [ 785.311130] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b with Priority: HIGH for action security_group_rules [ 785.311217] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGH for action security_group_rules [ 785.311305] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92110755-d0a0-45ce-81ab-f52b3527b07a with Priority: HIGH for action security_group_rules [ 785.311421] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4689714c-abe3-425f-b780-ee3049d244c0 with Priority: HIGH for action security_group_rules [ 785.311555] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3ab807-fc85-4c12-b831-97beee7da03a with Priority: HIGH for action security_group_rules [ 785.311648] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGH for action security_group_rules [ 785.311746] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f224771b-3e74-478f-8e84-a05495ab099b with Priority: HIGH for action security_group_rules [ 785.313031] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af39d9f2-2893-4829-94fc-ff7334ea19fd with Priority: HIGH for action security_group_rules [ 785.313420] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.313590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.313628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.313880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.313964] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.315578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.315691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.315751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.315934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.316094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.316189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.316249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.316391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.316476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.316566] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.318431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fa10332-8f6d-441c-9249-f0038b2c7934 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.318431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.318431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.318841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.318950] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fa10332-8f6d-441c-9249-f0038b2c7934',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.320739] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.320872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.320948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.321743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.321743] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fb8f28-1898-4b72-aa0e-58d3cd80323e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.322427] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.322565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.322608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.323215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.323215] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5cd8d4c-0799-476c-99a4-61a972ef02e0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.324508] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.324630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.324689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.324958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.324958] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.330104] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.330283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.330539] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.330539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.330783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.330783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.330855] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.331973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.332148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.332148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.332989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.332989] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7264374f-cfc2-4efe-a3e1-37e97b0370c2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.333491] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.333722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.333810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.333972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.334050] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.334896] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.336953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.336953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.336953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.336953] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.339765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.339921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.340162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.340402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.340518] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.340800] env[66919]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 785.341830] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.341952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.342270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.343413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.343413] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7c20e0ac-3cc6-4d82-99dc-7e144a069371',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.343808] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.344058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.344058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.344706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.344706] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.345675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a88ee71-4c82-4813-b129-b022cced6be1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.345795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.345860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.346017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.346077] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a88ee71-4c82-4813-b129-b022cced6be1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.347101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.347253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.347345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.347546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.348188] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d45aa44-8e7c-48b8-b926-f1958506fc0b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.348935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.349136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.349239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.349443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.349517] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.350641] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-92110755-d0a0-45ce-81ab-f52b3527b07a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.351288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.351288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.351288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.351288] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('92110755-d0a0-45ce-81ab-f52b3527b07a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.351999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4689714c-abe3-425f-b780-ee3049d244c0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.352154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.352232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.353038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.353153] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4689714c-abe3-425f-b780-ee3049d244c0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.354149] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a3ab807-fc85-4c12-b831-97beee7da03a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.354317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.354427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.354623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.354758] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a3ab807-fc85-4c12-b831-97beee7da03a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.355940] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.355940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.355940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.356115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.356223] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.357125] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f224771b-3e74-478f-8e84-a05495ab099b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.357221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.357262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.357417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.357484] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f224771b-3e74-478f-8e84-a05495ab099b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.357705] env[66919]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 785.358385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af39d9f2-2893-4829-94fc-ff7334ea19fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.358557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.358557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.358704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.358779] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af39d9f2-2893-4829-94fc-ff7334ea19fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.362163] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.362275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.362568] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fa10332-8f6d-441c-9249-f0038b2c7934 with status ACTIVE [ 785.362710] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.362933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.363099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.363331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.363378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.363615] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.363758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.363851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.364093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.364282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.364397] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.364490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.364554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.364709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.364761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.364834] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fa10332-8f6d-441c-9249-f0038b2c7934 is going to be updated. [ 785.367363] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.403654] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.403819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.403865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.404244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.404244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.404569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fa10332-8f6d-441c-9249-f0038b2c7934" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.627266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 785.627467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.627638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.627888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.628098] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.628214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.628347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.628470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.628538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.628621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.628702] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.629638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.630116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.630116] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.630116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.630338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.630338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.630338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.630433] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.876412] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.913607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.913607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.913607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.913607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.913882] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.914195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.914399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.914753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.914847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.914985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.915160] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.929296] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.929296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.929296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.929594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.929594] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.929697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.929697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.930525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.930525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.930525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.930525] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.932225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.932225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.932225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.932225] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.939454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.939454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.939454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.939454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.939454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.939454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.939454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.942752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.942866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.942967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.943071] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.944777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.944918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.944960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.945244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.946611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.946611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.946611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.946611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.946611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.946611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.946611] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.948738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.948943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.949143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.949439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.949721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.949991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.950259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.950401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.950689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.950689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.950810] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.955298] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.955465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.956179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.956179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.956419] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.956495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.956548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.957217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.957217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.957217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.957217] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.957469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.957469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.957585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.957795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.958017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.958085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.958608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.958608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.958825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.958982] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.962201] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.962354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.962399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.962612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.962773] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.962904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.962969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.963161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.963260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.963359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.963717] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.963717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.964016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.964055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.964181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.964277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.964337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.964477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.964571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.964739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.964739] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.967337] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.967852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.967852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.967852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.971425] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.971617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.971617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.971964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.971964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.972098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.972149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.972280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.972355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.972456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.972625] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.972721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.972778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.972917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.973079] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.973170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.973242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.973381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.973471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.973550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.973638] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.982698] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.982698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.032486] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.032725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.057706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.057959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.058913] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.059078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.059953] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.060171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.060842] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.061050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.068922] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.068922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.070018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.070531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.071279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.071414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.072278] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.072377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.073216] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 786.073722] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.073844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.077410] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 786.077939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.078259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fb8f28-1898-4b72-aa0e-58d3cd80323e is going to be deleted. [ 786.079584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.079813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.083839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.083839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.120464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.120932] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a3ab807-fc85-4c12-b831-97beee7da03a is going to be deleted. [ 786.121707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.122230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.134111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.134252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.134414] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.155415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.155635] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5cd8d4c-0799-476c-99a4-61a972ef02e0 is going to be deleted. [ 786.156888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.157371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.201768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.201934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.208694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.208797] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f224771b-3e74-478f-8e84-a05495ab099b is going to be deleted. [ 786.213805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.213805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.222614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.223893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.236192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.236431] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 92110755-d0a0-45ce-81ab-f52b3527b07a is going to be deleted. [ 786.237560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.237816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.240134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.240292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.265742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.265967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7264374f-cfc2-4efe-a3e1-37e97b0370c2 is going to be deleted. [ 786.267212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.267419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.293738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.293914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.295393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.295636] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c is going to be deleted. [ 786.297181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.297461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.378856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.379179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.379289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.379541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.379711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.379818] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be created. [ 786.398527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.398925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.400449] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.400815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.406912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.406912] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a88ee71-4c82-4813-b129-b022cced6be1 is going to be deleted. [ 786.407680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.408021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.461077] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.461496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.464016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.464016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.465420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.465653] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.472616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.472898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.472898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.473105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.473374] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.474723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.474723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.474723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.474891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.475270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.475457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.475580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.476636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.476636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.476636] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.482042] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.482966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.482966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.482966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.482966] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.482966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.482966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.483432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.483432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.483432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.486515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.486515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.486515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.486515] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.487437] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb: rpc.has_security_group_logging(os_id): False [ 786.492157] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54a8eb66-4aa1-440c-af86-e5e65121f69f: rpc.has_security_group_logging(os_id): False [ 786.494179] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 760a77bb-57f0-44e3-b609-b74fb3c191fd: rpc.has_security_group_logging(os_id): False [ 786.522533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.522648] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d45aa44-8e7c-48b8-b926-f1958506fc0b is going to be deleted. [ 786.524233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.524474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526365] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.526520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.526520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.526757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.526950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.560495] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.560495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.570827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.570827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.574625] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: UNINITIALIZED for 2s [ 786.576364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.576776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.578849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.578849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.600298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.600760] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be deleted. [ 786.601635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.601887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.605768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.606024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.638419] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.643372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.643372] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4689714c-abe3-425f-b780-ee3049d244c0 is going to be deleted. [ 786.644839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.645154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.674943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.675152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.685054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.685054] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7c20e0ac-3cc6-4d82-99dc-7e144a069371 is going to be deleted. [ 786.685532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.685760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.714249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.714249] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af39d9f2-2893-4829-94fc-ff7334ea19fd is going to be deleted. [ 786.715639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.715639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.715639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.715639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fb8f28-1898-4b72-aa0e-58d3cd80323e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.715867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.715867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.715966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.716060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a3ab807-fc85-4c12-b831-97beee7da03a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.716597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.716842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.716930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.717111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5cd8d4c-0799-476c-99a4-61a972ef02e0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.717251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.717400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.717481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.717763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f224771b-3e74-478f-8e84-a05495ab099b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.717867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.717954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.718049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.718163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-92110755-d0a0-45ce-81ab-f52b3527b07a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.718289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.718432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.718504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.718611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7264374f-cfc2-4efe-a3e1-37e97b0370c2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.718736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.718878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.719121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.719282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64769a1c-fcf0-4a3c-a442-a8fd8ce74d0c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.719419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.719564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.743544] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.743703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.787376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.788218] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.788732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.788732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.788966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.789362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.789509] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.789697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.789850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.790122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.790252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.790626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.790781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.790895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.791281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.791376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.791547] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 786.793316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.793608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.796436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.796641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.842689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.842689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.846685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.847393] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.847551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.847628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.847896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.847988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.848248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.848356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.848422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.848587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.848664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.848861] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.848996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.849076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.849236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.849301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.849402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 786.850686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.850857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.851292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a88ee71-4c82-4813-b129-b022cced6be1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.851483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.851483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d45aa44-8e7c-48b8-b926-f1958506fc0b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.851810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.852011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.852097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.852211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.852329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.852470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.907082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.907082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.943263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.943567] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.943699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.943756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.943965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.944069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.944284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.944385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.944448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.944608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.944683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.944862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.945257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.945381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.946570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.946692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.947150] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 786.948134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.948444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.948593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7c20e0ac-3cc6-4d82-99dc-7e144a069371" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.948946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.949147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.949308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.949455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4689714c-abe3-425f-b780-ee3049d244c0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.949648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.949833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.949937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.950171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af39d9f2-2893-4829-94fc-ff7334ea19fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.970632] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c800be9-5a1f-4e7d-acfb-e24947683dc0: rpc.has_security_group_logging(os_id): False [ 786.979230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fc0f601-8257-4527-8366-40ea56f5ccdd: rpc.has_security_group_logging(os_id): False [ 786.990032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008: rpc.has_security_group_logging(os_id): False [ 787.012440] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.012691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.012778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.013064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.022370] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.022370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.057786] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.058415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.069396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.069586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.073064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.073379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.073506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.073574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.073864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.073957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.074207] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.074317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.074353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.074514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.074610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.074817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.074899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.074960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.075257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.075359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.075558] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 787.077157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.077347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.079634] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.079766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.143489] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.143489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.143489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.143489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.143489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.143489] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 787.155408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.155684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.155811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.155894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.156142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.156233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.156446] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.156547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.156619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.156856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.157659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.158281] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.158454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.158454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.158577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.158661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.158763] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 787.160140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.161037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.164760] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.164922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.198570] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 412 Client Error: Precondition Failed for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/groups/dc4eed96-db0f-482c-9dd1-a49874fad4b1 [ 787.198734] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 787.220504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.220632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.238013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.239032] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.239032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.239032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.239032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.239032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.239396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.239396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.239396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.239513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.239554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.239767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.239851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.239913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.241479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.241624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.241721] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 787.243370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.245208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.245363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.246810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.246937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.247302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.249843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.250073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.250850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.251445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.251639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.251796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.369289] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 787.380477] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 787.384647] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 787.384647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.385839] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 787.472164] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.474113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.475091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.475091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.475091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.553564] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 787.576452] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.576452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.576452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.576452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.576452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.600983] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 787.613240] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 787.613240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.613240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.613240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.613789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.614668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.615144] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.615404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.615559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.615840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.616042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.616221] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 787.676581] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.679024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.679024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.679024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.679024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.690079] env[66919]: INFO networking_nsxv3.common.synchronization [None req-dab3b4df-3587-4599-8dff-cfe2734221e6 None None] Enqueued Resource ID: 63cdf22f-c29e-46cb-8824-028a397e49be with Priority: HIGHEST for action port [ 787.692215] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cdf22f-c29e-46cb-8824-028a397e49be with Priority: HIGHEST for action port [ 787.692215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-63cdf22f-c29e-46cb-8824-028a397e49be taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.695021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63cdf22f-c29e-46cb-8824-028a397e49be" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.695021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63cdf22f-c29e-46cb-8824-028a397e49be" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.695021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63cdf22f-c29e-46cb-8824-028a397e49be" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.695021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cdf22f-c29e-46cb-8824-028a397e49be',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.695021] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 788.198349] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63cdf22f-c29e-46cb-8824-028a397e49be [ 788.198637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.198777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.198847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.199113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.199187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.199284] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63cdf22f-c29e-46cb-8824-028a397e49be already deleted. [ 788.199366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63cdf22f-c29e-46cb-8824-028a397e49be" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.590894] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 788.591267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.591267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.591449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.591649] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.591758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.591820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.591980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.592082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.592170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.592261] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.659546] env[66919]: INFO networking_nsxv3.common.synchronization [req-3bc73663-efcd-428a-abea-225cd49ed001 req-8934238e-7eb0-4417-b516-dd0b1dfe9fed tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 788.659684] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 788.659985] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.660143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.660236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.660392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.660605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.660736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.660796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.660966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.661086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.661197] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.085995] env[66919]: INFO networking_nsxv3.common.synchronization [None req-65643f88-5229-4491-b92a-7052915b1ef8 tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 789.088055] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 789.088055] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.088440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.088440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.088738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.088976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.096877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.097035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.097102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.097313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.097541] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.097658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.097714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.098328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.098328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.098328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.098328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.099917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.100455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.100455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.100455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.100713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.100713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.100964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.100964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.100964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.101102] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.163440] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.338705] env[66919]: INFO networking_nsxv3.common.synchronization [None req-3221052c-f311-4a17-8d8c-e26e47d5a8de tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 789.339741] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 789.340248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.340406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.388069] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 789.388326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.396034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 789.396279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.401175] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 789.402448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.573331] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 789.573678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.603394] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31932c99-4ae5-4683-9701-736f699e8f83: rpc.has_security_group_logging(os_id): False [ 789.616470] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 789.616470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.624520] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.624520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.624913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.624913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.624913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.625120] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.626035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.626035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.627044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.627044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.627270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.627442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.628129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.628129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.628129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.628129] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be created. [ 789.630015] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.630132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.630348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.630548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.630610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.632439] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 already deleted. [ 789.632439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.632439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.632439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.632439] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.666344] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.698779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.698940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.699028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.699267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.699451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.707124] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 789.707777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.707777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.707777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.707977] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.708252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.708252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.708407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.708493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.708661] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.710961] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 790.157021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.157388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.157507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.157913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.158055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.158208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 already deleted. [ 790.158305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.169148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.169365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.169464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.169667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.169759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.169900] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 790.210282] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.210486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.210584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.210895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.211122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.213931] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.225313] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 790.719271] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.788026] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5fc1395a-a10d-41f9-8e56-4e090bb1d026 None None] Enqueued Resource ID: 450e9a5c-4175-482e-9866-b720c1906e26 with Priority: HIGHEST for action port [ 790.788687] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 450e9a5c-4175-482e-9866-b720c1906e26 with Priority: HIGHEST for action port [ 790.789916] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-450e9a5c-4175-482e-9866-b720c1906e26 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.790105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-450e9a5c-4175-482e-9866-b720c1906e26" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.790199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-450e9a5c-4175-482e-9866-b720c1906e26" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.791099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-450e9a5c-4175-482e-9866-b720c1906e26" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.791201] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('450e9a5c-4175-482e-9866-b720c1906e26',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.222452] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.222452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.222666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.222709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.222879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.223103] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 791.236498] env[66919]: INFO networking_nsxv3.common.synchronization [req-517b56b8-55b5-4645-ad44-bf9c37118bb6 req-e4509cb2-ed16-4649-915f-f4e3c97a6a3b tempest-ServerRescueTestJSONUnderV235-2040369462 tempest-ServerRescueTestJSONUnderV235-2040369462-project-member] Enqueued Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 791.237368] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 with Priority: HIGHEST for action security_group_members [ 791.238744] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.238744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.256720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.257076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.257339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.257723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.257883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.272876] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 791.295321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 450e9a5c-4175-482e-9866-b720c1906e26 [ 791.295572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.295711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.295819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.296208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.296351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.296462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:450e9a5c-4175-482e-9866-b720c1906e26 already deleted. [ 791.296571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-450e9a5c-4175-482e-9866-b720c1906e26" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.724862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 791.724862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.237438] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 4s [ 793.289597] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 793.290025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.290273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.290668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.290969] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.291215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.291307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.291513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.291609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.291703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.291918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc4eed96-db0f-482c-9dd1-a49874fad4b1 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.292031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.292119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.292354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.292527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.292731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.292731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.292858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.292913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.293024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.293129] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.294200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.294456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.294702] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.294892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.294994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.295279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.295420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.295584] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.798350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc4eed96-db0f-482c-9dd1-a49874fad4b1: rpc.has_security_group_logging(os_id): False [ 793.800222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.800412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.800412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.800587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.819260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.819466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.825612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.825940] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.826103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.826185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.826464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.826511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.826683] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 793.827929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.828178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.828265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.828492] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.828604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.828665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.828821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.828955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.829128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.829218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.829273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.829418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.829495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.829728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.829837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.829909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.830053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.830136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.830208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be updated. [ 793.878484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.878701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.878701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.878886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.879048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.896929] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 793.920353] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.920574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.920633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.920903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.921072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.937699] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: IN_PROGRESS for 2s [ 794.146092] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f4155cab-4cc0-462e-9597-94fecdc44358 None None] Enqueued Resource ID: 6fd38ee4-2f5f-4423-a92f-7459f44c5895 with Priority: HIGHEST for action port [ 794.146530] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6fd38ee4-2f5f-4423-a92f-7459f44c5895 with Priority: HIGHEST for action port [ 794.146871] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6fd38ee4-2f5f-4423-a92f-7459f44c5895 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.146995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6fd38ee4-2f5f-4423-a92f-7459f44c5895" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.147116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6fd38ee4-2f5f-4423-a92f-7459f44c5895" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.147862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6fd38ee4-2f5f-4423-a92f-7459f44c5895" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.147862] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6fd38ee4-2f5f-4423-a92f-7459f44c5895',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.261808] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 794.262067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.503570] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-c5e9c013-359e-4a01-b000-ae94dbc2b0df tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 794.504334] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 794.504787] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.504935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.505064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.505365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.505566] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.505694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.505790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.506093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.506206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.506324] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.652190] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6fd38ee4-2f5f-4423-a92f-7459f44c5895 [ 794.652470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.652629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.652725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.652962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.653070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.653168] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6fd38ee4-2f5f-4423-a92f-7459f44c5895 already deleted. [ 794.653249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6fd38ee4-2f5f-4423-a92f-7459f44c5895" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.852878] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.853129] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.853261] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.853613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.853921] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.854121] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.854236] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.854507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.854750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.854977] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.855098] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.855207] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.855312] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.855435] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.855542] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.855675] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.877730] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.877934] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.878107] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.878302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.878657] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.878863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.879022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.879389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.879528] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2811ede-bef4-4d5f-a7e9-1ab089a287e7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.009276] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.384923] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.385091] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.385146] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.389023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port a2811ede-bef4-4d5f-a7e9-1ab089a287e7 not found, creating... [ 795.389023] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.389023] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.389023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.389609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.389609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.389609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.389609] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: a2811ede-bef4-4d5f-a7e9-1ab089a287e7 is going to be created. [ 795.409832] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.410172] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.410402] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.410810] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.411142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.411403] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.512145] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.907720] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 795.907720] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 deletion is rescheduled due to dependency. [ 795.907720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.953197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 in Status: SUCCESS [ 795.953197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.953354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.953618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.953680] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.015558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.015902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.015979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.016334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.016441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.016974] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 796.046280] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.046828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.046828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.046948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.057735] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 796.156729] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-4d8c011c-f1b7-4888-be6a-bfebbbe6ecf9 service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 796.157626] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-4d8c011c-f1b7-4888-be6a-bfebbbe6ecf9 service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 796.157626] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-4d8c011c-f1b7-4888-be6a-bfebbbe6ecf9 service nova] Enqueued Resource ID: a2811ede-bef4-4d5f-a7e9-1ab089a287e7 with Priority: HIGHEST for action port [ 796.157840] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 796.157840] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 796.157919] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2811ede-bef4-4d5f-a7e9-1ab089a287e7 with Priority: HIGHEST for action port [ 796.158232] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.158354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.158473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.158613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.158691] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.159659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.159659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.159894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.159981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.160039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.160191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.162802] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2811ede-bef4-4d5f-a7e9-1ab089a287e7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.482629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.484460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.484581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.484838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.484937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.485059] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 is going to be deleted. [ 796.549644] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.550114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.550114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.550248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.550248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.550738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.550833] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc4eed96-db0f-482c-9dd1-a49874fad4b1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.661942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.662156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.663462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2811ede-bef4-4d5f-a7e9-1ab089a287e7 with status ACTIVE [ 796.663658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.663786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.664053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.664153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.664365] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.664469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.664554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.664748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.665044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.665151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.665213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.665366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.665456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.665564] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2811ede-bef4-4d5f-a7e9-1ab089a287e7 is going to be updated. [ 796.696824] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.697110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.697110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.697352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.697586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.697653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2811ede-bef4-4d5f-a7e9-1ab089a287e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.813800] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4c0c5067-bba5-4cba-8e41-5399a9471769 None None] Enqueued Resource ID: 2e18bcf6-7023-462d-bf67-c87fc96c8f49 with Priority: HIGHEST for action port [ 796.814574] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e18bcf6-7023-462d-bf67-c87fc96c8f49 with Priority: HIGHEST for action port [ 796.815174] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e18bcf6-7023-462d-bf67-c87fc96c8f49 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.815174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e18bcf6-7023-462d-bf67-c87fc96c8f49" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.815174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e18bcf6-7023-462d-bf67-c87fc96c8f49" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.816646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e18bcf6-7023-462d-bf67-c87fc96c8f49" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.816646] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e18bcf6-7023-462d-bf67-c87fc96c8f49',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.078013] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.078013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.078013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.078013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.078013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.078013] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc4eed96-db0f-482c-9dd1-a49874fad4b1 already deleted. [ 797.078013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc4eed96-db0f-482c-9dd1-a49874fad4b1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.441417] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e18bcf6-7023-462d-bf67-c87fc96c8f49 [ 797.441758] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.441940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.442060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.442357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.442762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.442762] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e18bcf6-7023-462d-bf67-c87fc96c8f49 already deleted. [ 797.442762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e18bcf6-7023-462d-bf67-c87fc96c8f49" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.069885] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 798.069885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.069885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.070367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.070367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.070367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.070484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.070567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.070643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.070729] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.574284] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.076509] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.577703] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-60544569-5486-4a83-a7c6-3a6c2b8268b0 tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 799.578335] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 799.578723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.578850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.578934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.579153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.579242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.579334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 799.580510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.580622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.606465] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.606680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.606753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.606969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.607149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.617342] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 799.995294] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.995294] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.995460] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.996194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.996194] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.996350] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.996490] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.996772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.996940] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.997327] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.997444] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.997609] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.997815] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.999251] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.999385] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.999528] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 800.021692] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 800.021692] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 800.021692] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 800.021692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-910" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.021692] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-f9b9e327-dae3-4196-a966-59a0ea74a197 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.021692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.021692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.021692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.021692] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9b9e327-dae3-4196-a966-59a0ea74a197',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.525149] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.525521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.525521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.525779] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.525926] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.526093] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port f9b9e327-dae3-4196-a966-59a0ea74a197 not found, creating... [ 800.526366] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.526522] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.526679] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.526879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.527023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.527317] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.527502] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.527567] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.527806] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.527942] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.528110] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: f9b9e327-dae3-4196-a966-59a0ea74a197 is going to be created. [ 800.554187] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.554477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.554762] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.555114] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.555371] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.555607] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.294952] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-d5a2f678-9383-4487-9a64-42e579a6f478 service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 801.295383] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-d5a2f678-9383-4487-9a64-42e579a6f478 service nova] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 801.295383] env[66919]: INFO networking_nsxv3.common.synchronization [req-9f74eab8-1462-4678-8458-805561fca324 req-d5a2f678-9383-4487-9a64-42e579a6f478 service nova] Enqueued Resource ID: f9b9e327-dae3-4196-a966-59a0ea74a197 with Priority: HIGHEST for action port [ 801.295867] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_rules [ 801.295997] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 801.296106] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9b9e327-dae3-4196-a966-59a0ea74a197 with Priority: HIGHEST for action port [ 801.296392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.296498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.296776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.296870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.297075] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9b9e327-dae3-4196-a966-59a0ea74a197 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.297178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.297328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.297452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.297538] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9b9e327-dae3-4196-a966-59a0ea74a197',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.628155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 801.628155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.628563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.628563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.628667] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.628745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.628815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.629410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.629410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.629410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.629410] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.631480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.631480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.631808] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.800700] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9b9e327-dae3-4196-a966-59a0ea74a197 with status ACTIVE [ 801.801024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.801174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.801243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.801458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.801587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.801734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.801870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.801932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.802114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.802842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.802842] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.802842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.802842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.802842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.802842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.803113] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9b9e327-dae3-4196-a966-59a0ea74a197 is going to be updated. [ 801.828681] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.828681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.828800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.829099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.829284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.829852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9b9e327-dae3-4196-a966-59a0ea74a197" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.134200] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.135988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.135988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.638412] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.140193] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.140366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.140432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.140667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.140843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.140924] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 803.188033] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.188033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.188033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.188033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.188033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.201883] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 805.168016] env[66919]: INFO networking_nsxv3.common.synchronization [req-19b71db7-f80b-480c-a8b8-7917f0eab2e6 req-b8465994-acf8-4c99-b4a3-17d0f061f271 tempest-ServersNegativeTestMultiTenantJSON-1461238548 tempest-ServersNegativeTestMultiTenantJSON-1461238548-project-member] Enqueued Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 805.168016] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 805.168016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.168016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.168016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.168016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.168016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.168016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.168016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.168598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.168598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.168598] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.217193] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 805.217474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.217692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.218326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.218326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.218326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.218566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.218647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.218763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.218985] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.592029] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.592029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-423" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.592029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-423" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.592029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-423" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.592029] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.592029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.592029] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.592907] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.593205] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.593518] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.593748] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.593944] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.594146] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.594363] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.594829] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.595201] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.617743] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.618221] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.618504] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.618783] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-423" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.619225] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-f7b84dfb-9509-4e67-b96c-af642212e17b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.620069] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.620069] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.620219] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.620467] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7b84dfb-9509-4e67-b96c-af642212e17b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.670913] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.671796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.671796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.671796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.671796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.672016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.672016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.672105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.672197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.672266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.672351] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 already deleted. [ 805.672429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.721821] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.123130] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.123315] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.123561] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.123877] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.124058] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.124225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port f7b84dfb-9509-4e67-b96c-af642212e17b not found, creating... [ 806.124543] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.124729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.124845] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.125082] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.125222] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.125516] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.125672] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.125788] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.125990] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.126138] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.126277] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: f7b84dfb-9509-4e67-b96c-af642212e17b is going to be created. [ 806.150998] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.151295] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.151445] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.151795] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.152103] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.152350] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.227277] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.729126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.729126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.729126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.729312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.729312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.729402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 806.759659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.759865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.759951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.760218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.760396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.771760] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 806.878357] env[66919]: INFO networking_nsxv3.common.synchronization [req-19b71db7-f80b-480c-a8b8-7917f0eab2e6 req-6be537dd-be91-4d1d-9e04-9c64ee78d41a service nova] Enqueued Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_rules [ 806.878637] env[66919]: INFO networking_nsxv3.common.synchronization [req-19b71db7-f80b-480c-a8b8-7917f0eab2e6 req-6be537dd-be91-4d1d-9e04-9c64ee78d41a service nova] Enqueued Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 806.879461] env[66919]: INFO networking_nsxv3.common.synchronization [req-19b71db7-f80b-480c-a8b8-7917f0eab2e6 req-6be537dd-be91-4d1d-9e04-9c64ee78d41a service nova] Enqueued Resource ID: f7b84dfb-9509-4e67-b96c-af642212e17b with Priority: HIGHEST for action port [ 806.880193] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_rules [ 806.880361] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 806.880637] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7b84dfb-9509-4e67-b96c-af642212e17b with Priority: HIGHEST for action port [ 806.880904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.881043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.881228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.881491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.881576] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.883293] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.883417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.883499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.886018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.886018] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.886018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7b84dfb-9509-4e67-b96c-af642212e17b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.886018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.886018] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7b84dfb-9509-4e67-b96c-af642212e17b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.179830] env[66919]: INFO networking_nsxv3.common.synchronization [req-21a783c2-e9a8-4f30-a3af-e2b94b0e89f1 req-5c720baf-bcc6-45e7-b1da-8a7396469e5e tempest-ServerRescueTestJSON-397859255 tempest-ServerRescueTestJSON-397859255-project-member] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 807.180338] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 807.180666] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.180798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.180865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.181085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.181242] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.181338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.181395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.181544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.181631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.181895] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.387095] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.387414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.388646] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.389540] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7b84dfb-9509-4e67-b96c-af642212e17b with status ACTIVE [ 807.389723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.389845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.389927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.390103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.390183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.390567] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.390567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.390567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.390773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.390773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.390952] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.390952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.391105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.391169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.391218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.391785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7b84dfb-9509-4e67-b96c-af642212e17b is going to be updated. [ 807.412834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.412987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.413072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.413284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.413421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.413579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7b84dfb-9509-4e67-b96c-af642212e17b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.684556] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.754985] env[66919]: INFO networking_nsxv3.common.synchronization [None req-910ab866-ed23-48a2-983d-0d4982efa104 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 807.755757] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 807.755997] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.756202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.756325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.756681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.756921] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.846383] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a9959bb2-025f-4163-b0fe-d5888aef5030 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 807.846938] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 807.847279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.847395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.893576] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.189748] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.280200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.280351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.280427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.280658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.280760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.280867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af639ee4-0cf3-4378-b556-ae5617090112 already deleted. [ 808.280956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.281123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.281317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.281737] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.395444] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.395819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.395819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.395893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.395962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.396137] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 is going to be created. [ 808.423889] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.423889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.423889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.423889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.423889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.434638] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: UNINITIALIZED for 2s [ 808.692429] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.692553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.692625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.692904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.693014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.693122] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 808.725198] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.725338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.725485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.727114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.727377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.737725] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 808.796317] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 808.796701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.796917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.797606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.797827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.797953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.798041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.798230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.798318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.798409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.798585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.798691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.798753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.798897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.799051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.799147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.799207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.799345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.799418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.799495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.799667] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.818188] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.818352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.818429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.818673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.818765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.818869] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af639ee4-0cf3-4378-b556-ae5617090112 already deleted. [ 808.818947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.303368] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31932c99-4ae5-4683-9701-736f699e8f83: rpc.has_security_group_logging(os_id): False [ 809.346265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.346265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.346631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.346695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.346779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.347103] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.347271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.347365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.347631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.347744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.349047] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.350258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.350340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.350675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.350790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.351036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.351182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.351294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.352945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.353088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.353232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 809.451550] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.452058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.452058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.452199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.452437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.467206] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 810.167923] env[66919]: INFO networking_nsxv3.common.synchronization [req-691506a7-d2c3-42ed-be34-9b789ab12cc3 req-a5dbf30c-8070-40d8-87cf-d6fa2b8dda4d tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 810.168656] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 810.168873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.168996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.168996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.169315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.169477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.169579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.169642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.169792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.169874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.169967] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.447458] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: SUCCESS [ 810.447571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.448585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.448771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.449020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.450403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.450403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.450633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.450766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.450934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.451078] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.544561] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.544914] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.545085] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.545938] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.546276] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.546672] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.546807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.547059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.547215] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.547423] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.547538] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.547644] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.547766] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.547873] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.547974] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.548122] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.573277] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.573555] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.574122] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.574359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-12" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.574694] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-6ba6f688-9519-428c-8eac-d949f51ed655 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.575038] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.575225] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.575556] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.576123] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba6f688-9519-428c-8eac-d949f51ed655',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.672779] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.748261] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 810.748525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.957018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.957018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.957018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.957018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.957018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.957703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.957703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.957703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.957703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.957703] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.079383] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.079383] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.079622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.079855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.080018] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.080232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 6ba6f688-9519-428c-8eac-d949f51ed655 not found, creating... [ 811.080421] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.080570] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.080690] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.080942] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.081098] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.081387] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.081580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.081640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.081845] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.081980] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.082133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 6ba6f688-9519-428c-8eac-d949f51ed655 is going to be created. [ 811.110041] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.110322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.110658] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.111098] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.111506] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.111935] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.175701] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.460305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 82828762-4a66-4fd4-8d16-f6ddfbc9eb01: rpc.has_security_group_logging(os_id): False [ 811.478876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.479060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.479117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.479309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.479398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.479585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.479682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.479735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.479886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.479961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.480163] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.480259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.480318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.480454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.480528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.480727] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.480810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.480856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.480983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.481070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.481465] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 is going to be created. [ 811.483391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 811.483596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.483756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.483921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.484015] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.551463] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.551807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.551807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.552638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.552638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.564313] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: IN_PROGRESS for 2s [ 811.679708] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.680089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.680695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.681030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.681495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.682568] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 811.719613] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.719754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.719823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.720056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.720207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.738381] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [req-691506a7-d2c3-42ed-be34-9b789ab12cc3 req-1a16be6e-d974-41f3-9683-efe3360e07d7 service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [req-691506a7-d2c3-42ed-be34-9b789ab12cc3 req-1a16be6e-d974-41f3-9683-efe3360e07d7 service nova] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [req-691506a7-d2c3-42ed-be34-9b789ab12cc3 req-1a16be6e-d974-41f3-9683-efe3360e07d7 service nova] Enqueued Resource ID: 6ba6f688-9519-428c-8eac-d949f51ed655 with Priority: HIGHEST for action port [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_rules [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 811.838343] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ba6f688-9519-428c-8eac-d949f51ed655 with Priority: HIGHEST for action port [ 811.838343] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.838343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.838343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.838343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.838343] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.838343] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.839219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.840408] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ba6f688-9519-428c-8eac-d949f51ed655 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.840969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.840969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.840969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.840969] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ba6f688-9519-428c-8eac-d949f51ed655',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.986014] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.986204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.986285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.986577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.986780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.986911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.987066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.987271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.987420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.987571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.987723] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.345860] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.345860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.345860] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ba6f688-9519-428c-8eac-d949f51ed655 with status ACTIVE [ 812.346240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.346240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.346515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.346590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.346708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.347052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.347214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.347277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.347507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.347617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.347802] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.347919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.347986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.348175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.348250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.348341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ba6f688-9519-428c-8eac-d949f51ed655 is going to be updated. [ 812.373096] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.373261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.373302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.373792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.373792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.373921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ba6f688-9519-428c-8eac-d949f51ed655" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.491034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.491034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.491034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.491380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.491380] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.491526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.491526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.491679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.491892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.491892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.491975] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.492665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.492665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.492665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.492665] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.492884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.492884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.492949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.493028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.493125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.493222] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.937130] env[66919]: INFO networking_nsxv3.common.synchronization [req-56169994-f377-4c98-b3a0-4c9f8f54daed req-fc8107fe-8353-4a33-92eb-b66cac1d44a3 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 812.937130] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 812.937130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.937130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.937130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.937760] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.995690] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 31932c99-4ae5-4683-9701-736f699e8f83: rpc.has_security_group_logging(os_id): False [ 813.015306] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.015699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.015869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.017551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.017551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.017551] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.018192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.021022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.021022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.021022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.022281] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 813.087789] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.090150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.090150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.090150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.090150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.104514] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 813.201163] env[66919]: INFO networking_nsxv3.common.synchronization [req-51992eb3-ee2f-4297-8513-960edde3cd70 req-6bcec050-227b-4224-93f4-59796e90f5da tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 813.202588] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 813.202588] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.202588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.202588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.202877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.202877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.202960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.202960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.203138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.203227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.203351] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.338312] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.338808] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.339012] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.339370] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.339757] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.340024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.340099] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.340768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.340768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.340938] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.341044] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.341161] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.341272] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.341414] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.342463] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.342463] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.362925] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.363134] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.363276] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.363451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.363782] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.363922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.364050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.364391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.364566] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc8b0a5-0afa-4e02-b83b-f7b1544e818b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.440429] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.440599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.440677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.440997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.463037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.464358] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.464358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.464358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.464358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.464358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.464358] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 813.497888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.498059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.498123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.498336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.498514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.510386] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 813.578368] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: SUCCESS [ 813.578561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.707367] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.748773] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 813.749110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.749217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.749462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.749707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.750913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.750913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.750913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.750913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.750913] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.867204] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.867463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.867600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.867900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.868084] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.868283] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port dbc8b0a5-0afa-4e02-b83b-f7b1544e818b not found, creating... [ 813.868557] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.868754] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.868904] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.869166] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.869406] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.869661] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.869832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.869948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.870186] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.870322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.870466] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: dbc8b0a5-0afa-4e02-b83b-f7b1544e818b is going to be created. [ 813.915622] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.915622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.915622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.915898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.916220] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.916471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.212388] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.254641] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.619855] env[66919]: INFO networking_nsxv3.common.synchronization [req-56169994-f377-4c98-b3a0-4c9f8f54daed req-7b4b32f6-96cd-4c4c-9aa9-6a3cb83154fa service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 814.619987] env[66919]: INFO networking_nsxv3.common.synchronization [req-56169994-f377-4c98-b3a0-4c9f8f54daed req-7b4b32f6-96cd-4c4c-9aa9-6a3cb83154fa service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 814.620074] env[66919]: INFO networking_nsxv3.common.synchronization [req-56169994-f377-4c98-b3a0-4c9f8f54daed req-7b4b32f6-96cd-4c4c-9aa9-6a3cb83154fa service nova] Enqueued Resource ID: dbc8b0a5-0afa-4e02-b83b-f7b1544e818b with Priority: HIGHEST for action port [ 814.620653] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 814.620780] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 814.620871] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbc8b0a5-0afa-4e02-b83b-f7b1544e818b with Priority: HIGHEST for action port [ 814.622849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.622984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.623060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.623932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.623932] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.624319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.624421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.624629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.624747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.624933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.625079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.625116] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbc8b0a5-0afa-4e02-b83b-f7b1544e818b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.716025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.716025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.716025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.716025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.716025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.716025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 814.749575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.751154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.751298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.751582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.753172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.757960] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.766129] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 815.121173] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 815.121692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.127082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.127221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.130352] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbc8b0a5-0afa-4e02-b83b-f7b1544e818b with status ACTIVE [ 815.130589] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.130729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.130808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.131045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.131155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.131368] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.131489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.131550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.131713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.131803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.132011] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.132149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.132236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.132392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.132465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.132568] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbc8b0a5-0afa-4e02-b83b-f7b1544e818b is going to be updated. [ 815.158690] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.158925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.158991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.159271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.159462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.159624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbc8b0a5-0afa-4e02-b83b-f7b1544e818b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.260775] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.260775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.260775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.261305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.261305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.261305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 815.320573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.320573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.320573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.320573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.320573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.330920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 815.523199] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 815.523199] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 815.523199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.523199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.523199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.523199] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.523199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.523199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.523564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.523564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.523564] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.754732] env[66919]: INFO networking_nsxv3.common.synchronization [req-45b31e48-db79-45d5-a513-be2e3ba46b70 req-0df2c585-1c35-47f4-9c2f-c113cfb847ac tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 815.755897] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 815.755897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.755897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.755897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.756209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.756209] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.756301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.756334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.756479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.756569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.756657] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.027232] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.082035] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.082265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.082265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.082569] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.082836] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.083012] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.083119] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.083350] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.083469] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.084084] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.084084] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 816.084084] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 816.084084] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 816.084278] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 816.084278] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 816.084407] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 816.108877] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 816.109130] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 816.109301] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 816.109489] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.109924] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-55f38f87-65b7-497a-9673-6149668e1981 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.110115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.110317] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.110703] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.110861] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f38f87-65b7-497a-9673-6149668e1981',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.259106] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.259484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.261740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.261740] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 already deleted. [ 816.261740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.529212] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.613025] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.613234] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.613361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.613651] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.613807] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.613959] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 55f38f87-65b7-497a-9673-6149668e1981 not found, creating... [ 816.614233] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.614389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.614504] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.614722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.615032] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.615296] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.615457] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.615653] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.615907] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.616115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.616252] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 55f38f87-65b7-497a-9673-6149668e1981 is going to be created. [ 816.637783] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.637996] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.638228] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.638508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.638859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.638988] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.777029] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 816.777029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.031790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.031945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.032045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.032256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.032349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.032451] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 817.064046] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.064255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.064368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.064629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.064808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.076257] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 817.342824] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 817.343226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.343226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.343515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.343851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.344031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.344076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.344264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.344502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.344616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.344699] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.384791] env[66919]: INFO networking_nsxv3.common.synchronization [req-45b31e48-db79-45d5-a513-be2e3ba46b70 req-ead44140-a2c9-4959-8434-7bdb5bfd6c0c service nova] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_rules [ 817.384791] env[66919]: INFO networking_nsxv3.common.synchronization [req-45b31e48-db79-45d5-a513-be2e3ba46b70 req-ead44140-a2c9-4959-8434-7bdb5bfd6c0c service nova] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 817.384930] env[66919]: INFO networking_nsxv3.common.synchronization [req-45b31e48-db79-45d5-a513-be2e3ba46b70 req-ead44140-a2c9-4959-8434-7bdb5bfd6c0c service nova] Enqueued Resource ID: 55f38f87-65b7-497a-9673-6149668e1981 with Priority: HIGHEST for action port [ 817.385638] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_rules [ 817.385714] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 817.385846] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55f38f87-65b7-497a-9673-6149668e1981 with Priority: HIGHEST for action port [ 817.386102] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.386224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.386293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.386571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.387863] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.387863] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.387863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.387863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.389420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.389631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.392689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.392771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.392926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.393024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.393128] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.394941] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-55f38f87-65b7-497a-9673-6149668e1981 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.394941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.394941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.395158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.395158] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55f38f87-65b7-497a-9673-6149668e1981',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.847512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.847802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.847802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.847935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.848131] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.848234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.848298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.848466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.848559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.848646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.848795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.848886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.848946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.849106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.850195] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.850195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.850195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.850195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.850195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.850195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.850195] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.896378] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.897433] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55f38f87-65b7-497a-9673-6149668e1981 with status ACTIVE [ 817.897668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.897795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.897857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.898077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.898148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.898325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.898480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.898480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.898625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.898700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.898894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.899012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.899075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.899253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.905536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.905717] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55f38f87-65b7-497a-9673-6149668e1981 is going to be updated. [ 817.907982] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.908152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.935961] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.936648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.936648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.936648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.936884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.936930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55f38f87-65b7-497a-9673-6149668e1981" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.353176] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb: rpc.has_security_group_logging(os_id): False [ 818.375979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.376185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.376262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.376535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.376624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.376828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.376936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.376981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.377147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.377238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.377858] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.377858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.377858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.377858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.377858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.378185] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.378185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.378185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.378311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.378355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.378444] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 818.408357] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.453134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.453305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.453360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.453613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.453772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.468905] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 818.911104] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.911313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.911383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.911566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.911681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.911791] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be created. [ 818.942073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.942364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.942364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.942524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.942586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.959140] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: UNINITIALIZED for 2s [ 819.086560] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 819.086781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.086949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.087190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.087386] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.087523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.087589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.087742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.087821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.087925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.087991] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.590130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.590560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.590626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.590833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.591035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.591163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.591225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.591397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.591484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.591576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.591739] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.591922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.591987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.592166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.592513] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.592644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.592787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.592891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.593023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.593157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.593299] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.095822] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 820.115768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.115916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.115978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.117958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.117958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.117958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.117958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.118566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.118681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.118793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.118876] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 820.193447] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.193573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.193617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.193883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.194055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.204590] env[66919]: INFO networking_nsxv3.common.synchronization [req-5267d2fb-86f6-4f1f-82a3-ce2a6ec0a56b req-a6243536-ab95-420d-890e-73977e2136d1 tempest-ServersNegativeTestMultiTenantJSON-1461238548 tempest-ServersNegativeTestMultiTenantJSON-1461238548-project-member] Enqueued Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 820.204590] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 with Priority: HIGHEST for action security_group_members [ 820.205190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.206030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.206030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.206030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.206030] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.206030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.206316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.206316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.206316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.206477] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('82828762-4a66-4fd4-8d16-f6ddfbc9eb01',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.213342] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 820.485337] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 820.485552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.709057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.709318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.709318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.709502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.709589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.709785] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.709885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.709941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.710105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.710179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.710265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 is going to be updated. [ 820.740414] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.740414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.740414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.740738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.740738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.751979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: IN_PROGRESS for 2s [ 820.970670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 820.970808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.971062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.971328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.971585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.971752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.971819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.972078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.972151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.972365] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.475617] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.475791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.475868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.476188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.476408] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.476515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.476574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.476740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.476830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.476931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.477896] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.478105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.478105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.478307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.478416] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.478556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.478615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.478805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.478872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.478954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.479056] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.981832] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9691f7e5-d5a3-4f2d-86cc-9f1494cee046: rpc.has_security_group_logging(os_id): False [ 821.997130] env[66919]: INFO networking_nsxv3.common.synchronization [req-09d952a3-97c2-4bc5-b49b-5b578e75b8b8 req-81404c50-e3b2-4ede-b185-e806964ff9eb tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 821.997130] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 821.997130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.997130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.997130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.998230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.998632] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.998997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.999267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.999622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.999834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.000058] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.002132] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.002427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.002622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.002921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.003141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.003435] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.003657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.004104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.004404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.007018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.007018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.007018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.007018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be created. [ 822.073442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.073569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.073613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.073849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.074053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.088153] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 822.225434] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 822.225665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.345530] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.345890] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.345961] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.346254] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.346583] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.346738] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.346852] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.347078] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.347229] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.347466] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.347580] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.347686] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.347791] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.347899] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.347999] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.348154] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.367270] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.367624] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.367779] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.367960] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.368307] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-9bb802c5-33f4-467e-9e1b-9da258c4b382 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.368482] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.368601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.369034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.369218] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bb802c5-33f4-467e-9e1b-9da258c4b382',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.510283] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.764133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 in Status: SUCCESS [ 822.765196] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 82828762-4a66-4fd4-8d16-f6ddfbc9eb01 deletion is rescheduled due to dependency. [ 822.765196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-82828762-4a66-4fd4-8d16-f6ddfbc9eb01" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.872920] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.872920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.872920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.872920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.872920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.872920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 9bb802c5-33f4-467e-9e1b-9da258c4b382 not found, creating... [ 822.873293] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.873351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.873477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.873677] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.873813] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.874111] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.874268] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.874453] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.874667] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.874805] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.876070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 9bb802c5-33f4-467e-9e1b-9da258c4b382 is going to be created. [ 822.897987] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.898152] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.898243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.898521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.898800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.899032] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.013415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.515201] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.515442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.515544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.515816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.515916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.516042] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 823.556119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.556466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.556466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.556579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.556726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.567446] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 823.665598] env[66919]: INFO networking_nsxv3.common.synchronization [req-09d952a3-97c2-4bc5-b49b-5b578e75b8b8 req-de982ecc-202c-4ccb-bbc2-6d1d9171ed7e service nova] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_rules [ 823.665790] env[66919]: INFO networking_nsxv3.common.synchronization [req-09d952a3-97c2-4bc5-b49b-5b578e75b8b8 req-de982ecc-202c-4ccb-bbc2-6d1d9171ed7e service nova] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 823.665927] env[66919]: INFO networking_nsxv3.common.synchronization [req-09d952a3-97c2-4bc5-b49b-5b578e75b8b8 req-de982ecc-202c-4ccb-bbc2-6d1d9171ed7e service nova] Enqueued Resource ID: 9bb802c5-33f4-467e-9e1b-9da258c4b382 with Priority: HIGHEST for action port [ 823.666503] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_rules [ 823.666649] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 823.666772] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bb802c5-33f4-467e-9e1b-9da258c4b382 with Priority: HIGHEST for action port [ 823.667723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.667835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.668072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.668162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.668367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bb802c5-33f4-467e-9e1b-9da258c4b382 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.668495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.668633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.668868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.668956] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bb802c5-33f4-467e-9e1b-9da258c4b382',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.101030] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 824.101030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.101030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.101392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.101392] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.173101] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9bb802c5-33f4-467e-9e1b-9da258c4b382 with status ACTIVE [ 824.173427] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.173634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.173819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.174436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.174590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.174899] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.175070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.175160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.175383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.175485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.175714] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.175832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.175902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.176142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.176180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.176252] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9bb802c5-33f4-467e-9e1b-9da258c4b382 is going to be updated. [ 824.200432] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.200607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.200684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.200931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.201123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.201310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bb802c5-33f4-467e-9e1b-9da258c4b382" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.605129] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.605320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.798729] env[66919]: INFO networking_nsxv3.common.synchronization [req-2365e44c-d4cf-47f6-9739-7ae85cc7d344 req-7684a428-d65f-47f4-a97f-85d0b80b9438 tempest-ServersTestManualDisk-1328103097 tempest-ServersTestManualDisk-1328103097-project-member] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 824.799295] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 824.799597] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.799713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.799771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.800036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.800190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.800366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.800427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.800586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.800672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.800768] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.096878] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.097471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.097471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.097653] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.097893] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.098060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.098176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.098413] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.098578] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.098791] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.098901] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 825.099018] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 825.099172] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 825.099292] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 825.099396] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 825.099565] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 825.120514] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 825.120826] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 825.120826] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 825.120982] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.121319] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.121490] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.121609] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.121923] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.122068] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.303816] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.303921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.304028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.304292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.304393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.304620] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.304735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.304792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.304976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.305071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.305178] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db already deleted. [ 825.305263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.579837] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 825.579837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.579837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.579837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.579837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.579837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.580259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.580564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.580750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.580935] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.624769] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.625038] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.625196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.625519] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.625745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.627176] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 not found, creating... [ 825.627176] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.627176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.627176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.627176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.627176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.627793] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.627793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.627793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.627793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.627953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.628186] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 is going to be created. [ 825.651033] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.651359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.651500] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.651838] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.652123] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.652392] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.083129] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.408275] env[66919]: INFO networking_nsxv3.common.synchronization [req-2365e44c-d4cf-47f6-9739-7ae85cc7d344 req-c9b723a0-9da7-4cf0-a7c4-b6e8a1e8a458 service nova] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 826.408556] env[66919]: INFO networking_nsxv3.common.synchronization [req-2365e44c-d4cf-47f6-9739-7ae85cc7d344 req-c9b723a0-9da7-4cf0-a7c4-b6e8a1e8a458 service nova] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 826.408772] env[66919]: INFO networking_nsxv3.common.synchronization [req-2365e44c-d4cf-47f6-9739-7ae85cc7d344 req-c9b723a0-9da7-4cf0-a7c4-b6e8a1e8a458 service nova] Enqueued Resource ID: f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 with Priority: HIGHEST for action port [ 826.410267] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_rules [ 826.410415] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 826.410533] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 with Priority: HIGHEST for action port [ 826.410888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.411034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.411194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.411742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.411839] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.412838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.412897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.412931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.413206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.413369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.413470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.413527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.413694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.415371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.415371] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.415371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.415371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.415371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.415371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.415371] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.585335] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.918516] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.919445] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.919551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.919911] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 with status ACTIVE [ 826.920096] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.920219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.920261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.921217] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.921217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.921656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.921656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.921656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.921891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.921891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.921987] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5 is going to be updated. [ 826.946221] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.946403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.946477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.946681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.946910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.946985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4dcce37-e1f7-4dd7-8f7a-2980874bd9b5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.960519] env[66919]: INFO networking_nsxv3.common.synchronization [req-47580e3c-76af-411b-bee7-c6a05408b0aa req-e6e7fb73-c2db-4fcb-8e29-6e6f5f94354f tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 826.960519] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 826.960798] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.960916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.960982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.961180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.961329] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.961425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.961482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.961677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.961764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.961856] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.088345] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.088630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.088760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.089115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.089941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.089941] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 827.128328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.128483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.128570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.128823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.129086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.143486] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 827.322927] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.323167] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.323334] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.323652] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.323957] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.324155] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.324380] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.324660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.325026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.325153] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.325210] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 827.325296] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 827.325404] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 827.325538] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 827.325625] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 827.325766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 827.351438] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 827.351680] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 827.351830] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 827.351990] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.352471] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-548b615d-a778-4802-9360-39c033666bdd taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.352689] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.352888] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.353292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.353534] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('548b615d-a778-4802-9360-39c033666bdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.423447] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.464151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.464386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.464458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.464690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.464820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.465010] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.465120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.465185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.465314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.465462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.465524] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be deleted. [ 827.496994] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.497215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.497269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.497668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.497767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.497806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.856589] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.857265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.857265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.857470] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.857681] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.858048] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 548b615d-a778-4802-9360-39c033666bdd not found, creating... [ 827.858384] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.858554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.858677] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.858903] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.859054] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.859350] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.859523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.859641] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.859850] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.859984] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.860141] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 548b615d-a778-4802-9360-39c033666bdd is going to be created. [ 827.880632] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.880851] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.881017] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.881297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.881529] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.881746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.926036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.926036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.926036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.926284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.926284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.926509] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db is going to be created. [ 827.969742] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.969742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.969742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.969742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.969742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.979133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: UNINITIALIZED for 2s [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [req-47580e3c-76af-411b-bee7-c6a05408b0aa req-430030de-138e-4ec1-8596-db1f06985d5d service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [req-47580e3c-76af-411b-bee7-c6a05408b0aa req-430030de-138e-4ec1-8596-db1f06985d5d service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [req-47580e3c-76af-411b-bee7-c6a05408b0aa req-430030de-138e-4ec1-8596-db1f06985d5d service nova] Enqueued Resource ID: 548b615d-a778-4802-9360-39c033666bdd with Priority: HIGHEST for action port [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 828.642899] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 548b615d-a778-4802-9360-39c033666bdd with Priority: HIGHEST for action port [ 828.643678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.643678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.643678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.643678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.643678] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.644379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.644504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.644548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.644725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.645110] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.645110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.645287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.645352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.645549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.645549] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.647128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-548b615d-a778-4802-9360-39c033666bdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.647128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.647128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.647361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.647361] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('548b615d-a778-4802-9360-39c033666bdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.149038] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.150230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 548b615d-a778-4802-9360-39c033666bdd with status ACTIVE [ 829.150483] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.150648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.150648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.150876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.151042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.151334] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.151488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.151563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.151756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.151840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.153109] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.153109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.153109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.153109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.153109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.153109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 548b615d-a778-4802-9360-39c033666bdd is going to be updated. [ 829.154205] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.154205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.157262] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 829.159341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.159341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.159341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.159341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.160037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.160114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.160343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.160503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.160608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.160745] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.179246] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.180151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.180151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.180151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.180151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.180474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-548b615d-a778-4802-9360-39c033666bdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.655799] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.663613] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.663756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.663912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.664076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.664713] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.664713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.664713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.664713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.664713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.664942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.664942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.665034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.665082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.665218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.665517] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.665517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.665517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.665658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.665729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.665806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.665895] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.990055] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: SUCCESS [ 829.990323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.990497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.990719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.990912] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.991041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.991425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.991578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.991669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.991754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.991861] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.158795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.158795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.158795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.159085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.159180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.159251] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be created. [ 830.169117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9691f7e5-d5a3-4f2d-86cc-9f1494cee046: rpc.has_security_group_logging(os_id): False [ 830.183396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.183580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.183648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.184063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.184063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.186489] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.186646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.186701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.186875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.186962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.187168] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.187271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.187334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.187508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.187590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.187779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.187873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.187931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.188085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.188159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.188350] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.188468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.188520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.188735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.188818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.188969] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 830.193805] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: UNINITIALIZED for 2s [ 830.260029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.260159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.260159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.260436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.260588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.273387] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 830.495034] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.997535] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a8087ec-9851-40d6-a912-030b8d9ac9db: rpc.has_security_group_logging(os_id): False [ 831.018875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.020720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.020908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.021538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.022685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.022685] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.022685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.022685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.023055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.023055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.023409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db is going to be created. [ 831.125337] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.125572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.125654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.125980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.127051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.143285] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: IN_PROGRESS for 2s [ 831.881663] env[66919]: INFO networking_nsxv3.common.synchronization [req-ebb839f0-8a97-4e50-9348-c9aae0915710 req-40d8545c-058e-4075-93a3-373943d7ab25 tempest-ListServerFiltersTestJSON-1472158494 tempest-ListServerFiltersTestJSON-1472158494-project-member] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 831.882222] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGHEST for action security_group_members [ 831.882538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.882663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.882737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.882936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.883103] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.883202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.883263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.883411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.883524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.883591] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.203604] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: UNINITIALIZED for 4s [ 832.287631] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 832.287852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.386618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.386838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.386838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.387076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.387171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.387392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.387514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.387593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.387755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.388162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.388162] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be updated. [ 832.417230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.417381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.417537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.417684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.417810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.429364] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: IN_PROGRESS for 2s [ 833.161038] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: SUCCESS [ 833.161379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.216232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 834.216232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.216232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.216706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.216706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.216821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.216821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.216957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.217049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.217146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.217256] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.442620] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 in Status: SUCCESS [ 834.443204] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 deletion is rescheduled due to dependency. [ 834.443204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.722295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.722295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.722295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.722295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.722295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.723442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.723442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.723442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.723442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.723442] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.226577] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 835.252455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.252603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.252675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.252881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.252965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.253165] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.253268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.253328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.253494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.253580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.253767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.253859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.253919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.254550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.254674] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.254740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.254775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.254934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.255385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.255515] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be created. [ 835.326983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.327190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.327238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.327557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.327759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.340518] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 836.882812] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 836.883129] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 837.356275] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 837.356558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.903333] env[66919]: INFO networking_nsxv3.common.synchronization [req-86943964-6fe8-43e6-afcd-f579544d949f req-11e40a49-d003-4299-b56a-6b600ef8bf1c tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 838.905960] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 838.906159] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.906432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.906594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.906868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.907139] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.907350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.907494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.907731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.909042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.909042] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.411761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.411962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.412039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.412208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.412325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.412593] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.412703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.412767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.412928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.413015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.413106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 839.447914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.448109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.448109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.448332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.448442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.457688] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 841.469975] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 841.470338] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 841.470338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.509918] env[66919]: INFO networking_nsxv3.common.synchronization [req-0c3191b0-94bd-44a5-984a-1c928e33780f req-89c5e459-269f-4b24-8d80-16ea439172cf tempest-TenantUsagesTestJSON-1323903715 tempest-TenantUsagesTestJSON-1323903715-project-member] Enqueued Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 842.509918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 842.509918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.509918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.510325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.510450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.510608] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.510706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.510766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.510915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.511045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.511093] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.855832] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.856038] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.856209] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.856492] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.856747] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.856899] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.857027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.857300] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.857405] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.857612] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.857722] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.857828] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.857931] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.858043] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.858147] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.858275] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.878062] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.879438] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.879438] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.879438] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.879438] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-4175e711-6605-4b29-bbf7-bc596aa84de6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.879438] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.879438] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.879853] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.879853] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4175e711-6605-4b29-bbf7-bc596aa84de6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.013612] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.013836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.013836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.014956] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.014956] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 already deleted. [ 843.014956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.383102] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.383323] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.383442] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.383728] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.383870] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.384022] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 4175e711-6605-4b29-bbf7-bc596aa84de6 not found, creating... [ 843.385946] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.385946] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.385946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.386509] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 4175e711-6605-4b29-bbf7-bc596aa84de6 is going to be created. [ 843.406057] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.406365] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.406494] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.406775] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.407018] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.407312] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.127598] env[66919]: INFO networking_nsxv3.common.synchronization [req-0c3191b0-94bd-44a5-984a-1c928e33780f req-75a62a3c-f4c7-4470-b12d-6ef411b597b3 service nova] Enqueued Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_rules [ 844.127886] env[66919]: INFO networking_nsxv3.common.synchronization [req-0c3191b0-94bd-44a5-984a-1c928e33780f req-75a62a3c-f4c7-4470-b12d-6ef411b597b3 service nova] Enqueued Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 844.127985] env[66919]: INFO networking_nsxv3.common.synchronization [req-0c3191b0-94bd-44a5-984a-1c928e33780f req-75a62a3c-f4c7-4470-b12d-6ef411b597b3 service nova] Enqueued Resource ID: 4175e711-6605-4b29-bbf7-bc596aa84de6 with Priority: HIGHEST for action port [ 844.128729] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_rules [ 844.128882] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 844.129154] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4175e711-6605-4b29-bbf7-bc596aa84de6 with Priority: HIGHEST for action port [ 844.129348] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.129469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.129603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.129788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.129871] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.130817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.130940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131644] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.131644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.131644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.131644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.131847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.131847] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.133743] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4175e711-6605-4b29-bbf7-bc596aa84de6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.133743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.133743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.134278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.134278] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4175e711-6605-4b29-bbf7-bc596aa84de6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.635991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.636180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.636434] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.637354] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4175e711-6605-4b29-bbf7-bc596aa84de6 with status ACTIVE [ 844.638148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.638287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.638329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.638528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.638693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.638862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.638936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.638972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.639131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.639962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.639962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.639962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.639962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.639962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.639962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.639962] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4175e711-6605-4b29-bbf7-bc596aa84de6 is going to be updated. [ 844.661624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.661751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.661825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.662040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.662176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.662327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4175e711-6605-4b29-bbf7-bc596aa84de6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.042279] env[66919]: INFO networking_nsxv3.common.synchronization [req-1e1c6d90-9dc3-41a8-b443-d7e1dc76b842 req-e71fc24a-40fa-4fb2-a1e9-7dffc802ba3f tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 845.045622] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 845.045960] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.046184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.046271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.046501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.046659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.046761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.046817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.046965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.047309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.047309] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.141560] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.422512] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.422733] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.422853] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.423325] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.423595] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.423747] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.423859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.424106] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.424265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.424469] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.424580] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.424733] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.424773] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.424890] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.425009] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.425167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.446219] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.446436] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.446597] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.446820] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.447168] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-beb09370-639d-41fa-9018-85f8d1131572 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.447394] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.447639] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.448052] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.448211] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb09370-639d-41fa-9018-85f8d1131572',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.549535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.549705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.549778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.550013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.550114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.550322] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.550419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.550474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.550619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.550695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.550782] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 already deleted. [ 845.550862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.643996] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.644188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.644258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.646265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.646265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.646265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 is going to be created. [ 845.676118] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.676118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.676118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.676118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.676118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.687926] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: UNINITIALIZED for 2s [ 845.951240] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.951476] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.951601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.951882] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.952043] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.952196] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port beb09370-639d-41fa-9018-85f8d1131572 not found, creating... [ 845.952449] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.952603] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.952714] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.952928] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.953077] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.953353] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.953505] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.953617] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.953813] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.953943] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.954107] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: beb09370-639d-41fa-9018-85f8d1131572 is going to be created. [ 845.974777] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.975012] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.975117] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.975386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.975605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.975816] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.717143] env[66919]: INFO networking_nsxv3.common.synchronization [req-1e1c6d90-9dc3-41a8-b443-d7e1dc76b842 req-18891283-4020-44e3-a837-3c61dbd85d8b service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 846.717473] env[66919]: INFO networking_nsxv3.common.synchronization [req-1e1c6d90-9dc3-41a8-b443-d7e1dc76b842 req-18891283-4020-44e3-a837-3c61dbd85d8b service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 846.717473] env[66919]: INFO networking_nsxv3.common.synchronization [req-1e1c6d90-9dc3-41a8-b443-d7e1dc76b842 req-18891283-4020-44e3-a837-3c61dbd85d8b service nova] Enqueued Resource ID: beb09370-639d-41fa-9018-85f8d1131572 with Priority: HIGHEST for action port [ 846.718309] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 846.718309] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 846.718309] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: beb09370-639d-41fa-9018-85f8d1131572 with Priority: HIGHEST for action port [ 846.718615] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.719152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.719152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.719347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.719347] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.720722] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.721078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.721195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.723480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.723480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.723480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-beb09370-639d-41fa-9018-85f8d1131572 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.723480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.723480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('beb09370-639d-41fa-9018-85f8d1131572',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.221522] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.221725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226161] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port beb09370-639d-41fa-9018-85f8d1131572 with status ACTIVE [ 847.226416] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.226577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.226675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.226903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.226996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.227204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.227295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.227359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.227514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.227785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.228018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.228133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.228214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.228385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.228462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.228549] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: beb09370-639d-41fa-9018-85f8d1131572 is going to be updated. [ 847.230411] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.259380] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.259571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.259644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.259852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.259988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.260282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-beb09370-639d-41fa-9018-85f8d1131572" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.698862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: SUCCESS [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.700480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.700480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.700480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.710993] env[66919]: INFO networking_nsxv3.common.synchronization [req-5aa294ec-1aba-4011-874a-34b4b637e1e4 req-a9e9a2d9-84a6-4581-8b80-ebbbf180aace tempest-ServerRescueTestJSON-397859255 tempest-ServerRescueTestJSON-397859255-project-member] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 847.711529] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGHEST for action security_group_members [ 847.712431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.712431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.712431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.712431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.712431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.712688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.712688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.712688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.712789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.712824] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.732455] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.759411] env[66919]: INFO networking_nsxv3.common.synchronization [req-dd3f083a-2941-405c-bf94-f7dc1a9842d3 req-f638c1b4-14a2-4aa5-983e-8ab329e710b0 tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 847.759411] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 847.759411] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.759411] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.759411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.760072] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.190226] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.190447] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.190761] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.191091] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.191448] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.191627] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.191753] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.192855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.192855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.192855] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.192855] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 848.192855] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 848.192855] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 848.192855] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 848.193531] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 848.193531] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 848.203808] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.203808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.203808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.204120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.204120] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.204257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.204257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.204356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.205504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.205504] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.205504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.206367] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.216240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.216455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.216580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.216728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.216821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.217057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.217197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.217255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.218028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.218028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.218028] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be updated. [ 848.226269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 848.226497] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 848.226603] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 848.226778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.227121] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-92af6c45-7d6d-4361-8f69-35c46fc3376d taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.227317] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.227439] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.227826] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.227951] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92af6c45-7d6d-4361-8f69-35c46fc3376d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.235556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.235556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.235556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.235556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.235556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.235822] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be created. [ 848.259819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.261415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.261415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.261415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.261415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.262936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.263125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.263210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.263418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.275989] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.275989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.275989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.275989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.275989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.279236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: IN_PROGRESS for 2s [ 848.289519] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: UNINITIALIZED for 2s [ 848.326431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.326698] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.326835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.326970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.327170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.327260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.327356] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 848.366049] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.366049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.366049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.366049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.366049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.380685] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 848.712616] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edb06d74-09ba-41c3-8b40-ff12c2672902: rpc.has_security_group_logging(os_id): False [ 848.731080] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.731462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.731597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.732261] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.732470] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.732897] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 92af6c45-7d6d-4361-8f69-35c46fc3376d not found, creating... [ 848.733034] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.733309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.733508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.733673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.733867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.734212] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.734375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.734510] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.734789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.734948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.735139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 92af6c45-7d6d-4361-8f69-35c46fc3376d is going to be created. [ 848.737638] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.737638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.737638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.738045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.738045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.738331] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.738331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.738605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.738756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.738756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.738948] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.739069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.739128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.739295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.739407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.739629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.739842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.739842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.740030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.740137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.740235] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 is going to be created. [ 848.767784] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.767784] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.767784] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.768145] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.768230] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.768507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.828904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.829111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.829217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.829424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.829831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.862840] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: IN_PROGRESS for 2s [ 849.368961] env[66919]: INFO networking_nsxv3.common.synchronization [req-e48e39d1-32fa-4c4b-bcad-bc556574cc8d req-490cd3a2-e7cf-4456-94f2-789b11c4a891 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 849.369332] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 849.369680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.369804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.369870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.370885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.370885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.370885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.370885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.370885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.370885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.370885] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.548761] env[66919]: INFO networking_nsxv3.common.synchronization [req-dd3f083a-2941-405c-bf94-f7dc1a9842d3 req-2049ccd9-9792-4a65-8ac6-758f0deea555 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 849.548882] env[66919]: INFO networking_nsxv3.common.synchronization [req-dd3f083a-2941-405c-bf94-f7dc1a9842d3 req-2049ccd9-9792-4a65-8ac6-758f0deea555 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 849.549071] env[66919]: INFO networking_nsxv3.common.synchronization [req-dd3f083a-2941-405c-bf94-f7dc1a9842d3 req-2049ccd9-9792-4a65-8ac6-758f0deea555 service nova] Enqueued Resource ID: 92af6c45-7d6d-4361-8f69-35c46fc3376d with Priority: HIGHEST for action port [ 849.549748] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 849.549921] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 849.550065] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92af6c45-7d6d-4361-8f69-35c46fc3376d with Priority: HIGHEST for action port [ 849.550432] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.550586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.550679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.550940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.551064] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.552199] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.552325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.552590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-92af6c45-7d6d-4361-8f69-35c46fc3376d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.552729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.552816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.553203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.553203] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92af6c45-7d6d-4361-8f69-35c46fc3376d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.875436] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.055587] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.055587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.057473] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 92af6c45-7d6d-4361-8f69-35c46fc3376d with status ACTIVE [ 850.057473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.057995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.057995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.057995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.057995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.058295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.058373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.058408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.058610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.058715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.058914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.059060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.060294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.060294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.060294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.060294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 92af6c45-7d6d-4361-8f69-35c46fc3376d is going to be updated. [ 850.089628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.089844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.089929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.090177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.090439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.090657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92af6c45-7d6d-4361-8f69-35c46fc3376d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.293078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd in Status: SUCCESS [ 850.293450] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd deletion is rescheduled due to dependency. [ 850.293800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.303573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 850.304073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.304073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.304553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.304553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.304922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.304922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.305895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.305895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.305895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.305895] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.377389] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.395203] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 850.395394] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc deletion is rescheduled due to dependency. [ 850.395604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.395837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.396189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.396436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.396756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.396888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.397293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.397504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.397646] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.757020] env[66919]: INFO networking_nsxv3.common.synchronization [req-04f0a7ae-2a24-462a-b6a1-4cc6740c72e0 req-f981221b-2b9d-4ed6-9dd7-620ad46cdcff tempest-ListImageFiltersTestJSON-425220867 tempest-ListImageFiltersTestJSON-425220867-project-member] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 850.757676] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 850.758558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.758558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.758558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.759898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.760210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.760342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.760404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.760589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.761554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.761554] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.808642] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.879996] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: SUCCESS [ 850.880346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.885573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.886838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.886838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.886838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.886838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.886838] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 850.900705] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.923988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.923988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.923988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.923988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.923988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.934802] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 851.118282] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.118282] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.118282] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.118646] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.118880] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.120206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.120206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.120206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.120206] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.120206] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.120206] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.120206] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.120593] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.120661] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.120772] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.120951] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.141738] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.141955] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.142124] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.142302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.142629] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-253ff224-f85d-4698-9f4c-183903f06527 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.142790] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.142981] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.143291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.143466] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('253ff224-f85d-4698-9f4c-183903f06527',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.264749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.264994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.264994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.265317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.265436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.265672] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.265801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.265881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.266116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.266217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.266329] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d already deleted. [ 851.266424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.312619] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 851.339091] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.339343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.339343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.339528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.339623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.339881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.339981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.340079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.340253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.340333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.340437] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be created. [ 851.404672] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.532250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.532374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.532522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.532755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.532937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.548178] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 851.651704] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.652184] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.652184] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.656281] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.656694] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.657018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 253ff224-f85d-4698-9f4c-183903f06527 not found, creating... [ 851.657498] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.657776] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.657964] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.658282] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.658442] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.658819] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.658998] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.659152] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.659470] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.659624] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.659810] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 253ff224-f85d-4698-9f4c-183903f06527 is going to be created. [ 851.699799] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.700107] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.700107] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.700396] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.700682] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.700946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.907509] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.907998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.907998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.908194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.908194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.908306] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 851.946269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.946515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.946592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.946760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.947035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.957300] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [req-04f0a7ae-2a24-462a-b6a1-4cc6740c72e0 req-1298636f-68f5-4be3-8050-17d4892f67db service nova] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_rules [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [req-04f0a7ae-2a24-462a-b6a1-4cc6740c72e0 req-1298636f-68f5-4be3-8050-17d4892f67db service nova] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [req-04f0a7ae-2a24-462a-b6a1-4cc6740c72e0 req-1298636f-68f5-4be3-8050-17d4892f67db service nova] Enqueued Resource ID: 253ff224-f85d-4698-9f4c-183903f06527 with Priority: HIGHEST for action port [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_rules [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 852.505269] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 253ff224-f85d-4698-9f4c-183903f06527 with Priority: HIGHEST for action port [ 852.506089] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.506524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.506696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.507102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.507341] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.509180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.509447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.509621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.509890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.510837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.511279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.511475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.511733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.511908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.512095] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.514741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-253ff224-f85d-4698-9f4c-183903f06527 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.515041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.515669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.515669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.515669] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('253ff224-f85d-4698-9f4c-183903f06527',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.945549] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 852.945825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.009505] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.009690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.016104] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.018266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 253ff224-f85d-4698-9f4c-183903f06527 with status ACTIVE [ 853.018671] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.018924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.019095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.019483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.019729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.020040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.020261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.020674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.020674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.020945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.021128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.021289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.021402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.021644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.021726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.021847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 253ff224-f85d-4698-9f4c-183903f06527 is going to be updated. [ 853.046840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.047735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.047735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.047735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.047735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.047735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-253ff224-f85d-4698-9f4c-183903f06527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.517965] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.566310] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 853.566310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.972061] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 853.972061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.972608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.972608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.972747] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.972845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.972909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.973077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.973169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.973263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.973378] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.022055] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.022315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.022399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.022657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.022751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.022858] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be created. [ 854.054728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.055447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.055447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.055447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.056988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.073407] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: UNINITIALIZED for 2s [ 854.475927] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.476202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.476843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.477274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.477529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.477640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.477721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.477928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.479066] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.479066] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.479066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.479515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.479515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.479515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.479515] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.784789] env[66919]: INFO networking_nsxv3.common.synchronization [req-0001ef0e-a9f8-4051-9fb3-73488ab65f79 req-59a67945-1070-4619-81ae-11942999a762 tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 854.785937] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 854.786087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.786252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.786345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.786581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.786767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.786867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.786929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.787123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.787225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.787323] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.982071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c38fec75-1824-4123-9a27-d70b3e15c2bc: rpc.has_security_group_logging(os_id): False [ 855.003683] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.003854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.003900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.004144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.004242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.004472] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.004577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.004643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.004829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.004915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.005073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.005174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.005238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.005379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.005454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.005632] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.005738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.005788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.005973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.005973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.006133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 855.068126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.068278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.068327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.068587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.068731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.087808] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 855.157767] env[66919]: INFO networking_nsxv3.common.synchronization [req-96ee4a56-1b50-45eb-8918-4eac1567ca4f req-3cbe5c51-e4a0-47d9-9714-513fe1115d60 tempest-ListServersNegativeTestJSON-1212628042 tempest-ListServersNegativeTestJSON-1212628042-project-member] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 855.158475] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGHEST for action security_group_members [ 855.158789] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.158885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.289189] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.792776] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.088035] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 856.088035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.088035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.088035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.088035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.088035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.088035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.088706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.088706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.088706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.088706] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.297944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.298406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.298720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.300314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.300314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.300314] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 856.333605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.333820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.333820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.334055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.334200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.346311] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 856.594701] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.594701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.594997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.594997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.595178] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.595286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.595358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.595658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.595658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.595779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.595830] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.595963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.596092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.596193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.596355] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.596437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.596509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.596647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.596713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.596794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.596892] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.855676] env[66919]: INFO networking_nsxv3.common.synchronization [req-7d9ae484-067b-4c90-ac3c-dac335a612e7 req-40a9558c-d458-4ee7-b2d2-8e1ec298b34a tempest-ListImageFiltersTestJSON-425220867 tempest-ListImageFiltersTestJSON-425220867-project-member] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 856.856620] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 856.857189] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.857394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.857509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.857838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.858206] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.858206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.858516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.858962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.858962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.858962] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.965023] env[66919]: INFO networking_nsxv3.common.synchronization [req-a131ba69-a293-407d-8e97-aa25ae454417 req-c6687339-613b-4079-beaa-de0a725e9b65 tempest-TenantUsagesTestJSON-1323903715 tempest-TenantUsagesTestJSON-1323903715-project-member] Enqueued Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 856.965023] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGHEST for action security_group_members [ 856.965023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.965023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.965023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.966067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.966439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.966687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.968527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.968527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.968527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.968527] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.099661] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 068fbd14-1f23-4a8c-9eb8-6b8df298f30d: rpc.has_security_group_logging(os_id): False [ 857.105466] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 857.106494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.121793] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.121971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.122026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.122862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.122862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.122862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.123129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.123129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.123993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.123993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.123993] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.123993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.125745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.125745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.125745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be created. [ 857.199531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.199681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.199758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.199947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.200146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.215070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 857.269361] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.270159] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.270159] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.270159] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.270287] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.270354] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.270455] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.271026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.271026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.271026] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.271261] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.271261] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.271766] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.271766] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 857.271766] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.271766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.301641] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.301828] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 857.301999] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.302215] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.302563] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-6978ed09-cbec-4ff2-850d-527b4585a8d8 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.302753] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.302872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.303274] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.303419] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6978ed09-cbec-4ff2-850d-527b4585a8d8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.361836] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.471682] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.471886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.471962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.472247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.472350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.472649] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.472740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.472740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.472913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.472990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.473110] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 is going to be updated. [ 857.504755] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.504914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.505017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.505268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.505432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.516702] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: IN_PROGRESS for 2s [ 857.805687] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.806049] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.806232] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.806601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.806764] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.806923] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 6978ed09-cbec-4ff2-850d-527b4585a8d8 not found, creating... [ 857.807212] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.807370] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.807486] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.807712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.807847] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.808152] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.808309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.808463] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.808683] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.808818] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.808966] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 6978ed09-cbec-4ff2-850d-527b4585a8d8 is going to be created. [ 857.832188] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.832445] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.832520] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.832800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.833050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.833352] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.865215] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.358230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 858.358573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.358711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.358904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.359125] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.359220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.359309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.359430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.359509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.359603] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.368471] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.368631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.368720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.369048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.369186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.369321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be updated. [ 858.412932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.413475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.413660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.414012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.415020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.427078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 858.629610] env[66919]: INFO networking_nsxv3.common.synchronization [req-7d9ae484-067b-4c90-ac3c-dac335a612e7 req-da103588-d115-4cc8-8c7b-8f057a76d401 service nova] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_rules [ 858.629913] env[66919]: INFO networking_nsxv3.common.synchronization [req-7d9ae484-067b-4c90-ac3c-dac335a612e7 req-da103588-d115-4cc8-8c7b-8f057a76d401 service nova] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 858.630177] env[66919]: INFO networking_nsxv3.common.synchronization [req-7d9ae484-067b-4c90-ac3c-dac335a612e7 req-da103588-d115-4cc8-8c7b-8f057a76d401 service nova] Enqueued Resource ID: 6978ed09-cbec-4ff2-850d-527b4585a8d8 with Priority: HIGHEST for action port [ 858.631536] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_rules [ 858.631904] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 858.631986] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6978ed09-cbec-4ff2-850d-527b4585a8d8 with Priority: HIGHEST for action port [ 858.632424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.632595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.632921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.633222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.633548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6978ed09-cbec-4ff2-850d-527b4585a8d8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.633735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.633782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.634108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.634240] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6978ed09-cbec-4ff2-850d-527b4585a8d8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.862350] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.862350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.862350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.862729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.862729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.862846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.862935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.863232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.863232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.863232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.863401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be updated. [ 858.893547] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.893623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.893738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.894246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.894246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.905194] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: IN_PROGRESS for 2s [ 859.137589] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6978ed09-cbec-4ff2-850d-527b4585a8d8 with status ACTIVE [ 859.137828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.137968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.138089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.138470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.138983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.138983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.138983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.138983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.139175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.139215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.139353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.139353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.139488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.139554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.141044] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6978ed09-cbec-4ff2-850d-527b4585a8d8 is going to be updated. [ 859.163821] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.163956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.163956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.164164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.164281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.165241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6978ed09-cbec-4ff2-850d-527b4585a8d8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.242092] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 859.242328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.242521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.242766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.242853] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.527049] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edb06d74-09ba-41c3-8b40-ff12c2672902 in Status: SUCCESS [ 859.527492] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 deletion is rescheduled due to dependency. [ 859.527492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.745813] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.746052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.814571] env[66919]: INFO networking_nsxv3.common.synchronization [req-78bf08b7-8522-4d5c-9f8e-5c49c515db96 req-79217a5c-9d33-44b3-8d9c-03f5d8397ba4 tempest-ServersAdminNegativeTestJSON-847607459 tempest-ServersAdminNegativeTestJSON-847607459-project-member] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 859.815921] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 859.816833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.817136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.817218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.817484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.818258] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.818258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.818258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.818518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.818687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.819018] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.205499] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.205773] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.205958] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.206992] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.207297] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.208038] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.208133] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.208376] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.208522] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.208730] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.208841] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.208948] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.209370] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.209370] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.209370] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.209547] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.231104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.231556] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.231556] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.231824] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.232017] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-33a0dfed-7891-4e00-870d-f5084cda9b25 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.232247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.232376] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.232716] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.232856] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a0dfed-7891-4e00-870d-f5084cda9b25',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.351491] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.439183] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 860.439430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.440976] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.440976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.440976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.735733] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.736189] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.736189] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.736569] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.736718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.736872] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 33a0dfed-7891-4e00-870d-f5084cda9b25 not found, creating... [ 860.737213] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.737413] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.737514] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.737758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.737916] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.738239] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.738362] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.738475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.738681] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.738813] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.738959] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 33a0dfed-7891-4e00-870d-f5084cda9b25 is going to be created. [ 860.775716] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.776544] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.776544] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.776544] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.776790] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.777066] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.824547] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.919933] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 31932c99-4ae5-4683-9701-736f699e8f83 in Status: SUCCESS [ 860.920153] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 deletion is rescheduled due to dependency. [ 860.920274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.944662] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.329403] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.329610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.329610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.329855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.330017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.330163] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 861.363510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.363654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.363758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.363994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.364781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.376192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 861.447036] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.567700] env[66919]: INFO networking_nsxv3.common.synchronization [req-78bf08b7-8522-4d5c-9f8e-5c49c515db96 req-04a731a9-8475-4720-beec-c4339b8d6f00 service nova] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_rules [ 861.568059] env[66919]: INFO networking_nsxv3.common.synchronization [req-78bf08b7-8522-4d5c-9f8e-5c49c515db96 req-04a731a9-8475-4720-beec-c4339b8d6f00 service nova] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 861.568059] env[66919]: INFO networking_nsxv3.common.synchronization [req-78bf08b7-8522-4d5c-9f8e-5c49c515db96 req-04a731a9-8475-4720-beec-c4339b8d6f00 service nova] Enqueued Resource ID: 33a0dfed-7891-4e00-870d-f5084cda9b25 with Priority: HIGHEST for action port [ 861.568575] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_rules [ 861.568720] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 861.568814] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a0dfed-7891-4e00-870d-f5084cda9b25 with Priority: HIGHEST for action port [ 861.569191] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.569270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.569298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.569498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.569579] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.570473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.570526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.571084] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-33a0dfed-7891-4e00-870d-f5084cda9b25 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.571294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.571343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.571621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.571700] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a0dfed-7891-4e00-870d-f5084cda9b25',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.950727] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.951045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.951045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.955288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.955405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.955521] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be updated. [ 861.985441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.986900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.986900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.986900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.986900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.997277] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 862.075013] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33a0dfed-7891-4e00-870d-f5084cda9b25 with status ACTIVE [ 862.075013] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.075013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.075013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.075013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.075013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.075303] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.075303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.075303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.076238] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.076238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.076238] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33a0dfed-7891-4e00-870d-f5084cda9b25 is going to be updated. [ 862.077694] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.077833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.100540] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.100684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.100822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.101097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.101246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.101411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33a0dfed-7891-4e00-870d-f5084cda9b25" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.532369] env[66919]: INFO networking_nsxv3.common.synchronization [req-72a9f7eb-6c38-404d-b812-4ffe6f5e8666 req-f4e2481a-3414-455b-90e5-b4f1dcb6bdcd tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 862.533201] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 862.533704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.535087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.535087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.535588] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.903936] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-43 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.904274] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.904274] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.904620] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.904835] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.904985] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.905226] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.905485] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.905657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.905868] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.906145] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.906262] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.906373] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.906522] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.906681] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.906821] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.926844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.927078] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.927292] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.927485] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.927875] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.928054] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.928127] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.928391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.928587] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff06e7c-0fbc-4ec7-b896-c219d07c1831',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.039210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.039210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.039210] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 already deleted. [ 863.039210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.389164] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 863.389164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.389164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.389164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.389340] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.389340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.389417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.389676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.389676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.389800] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.430474] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.430696] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.430823] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.431178] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.431308] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.431461] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 not found, creating... [ 863.431712] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.431866] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432017] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.432477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.432477] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.432603] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.432751] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.432863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.433247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.433356] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.433533] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 is going to be created. [ 863.459455] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.459701] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.459826] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.460359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.460500] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.460718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.511913] env[66919]: INFO networking_nsxv3.common.synchronization [None req-44549db2-b53a-4927-bd58-9de6279e97c4 tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 863.512969] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 863.513308] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.513438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.513491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.513737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.513873] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.653250] env[66919]: INFO networking_nsxv3.common.synchronization [None req-84b7812d-e89c-4001-9d41-a661f0a0054a tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 863.653824] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 863.654738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.654852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.892492] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.010350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.010350] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.010350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.010748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.010748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.010748] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.035255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.035430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.035522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.035691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.035775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.035874] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed already deleted. [ 864.036042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.036204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.036370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.036454] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.162589] env[66919]: INFO networking_nsxv3.common.synchronization [req-72a9f7eb-6c38-404d-b812-4ffe6f5e8666 req-9a3c9b66-0749-42ef-96e8-5b5cfbb1d86b service nova] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 864.162589] env[66919]: INFO networking_nsxv3.common.synchronization [req-72a9f7eb-6c38-404d-b812-4ffe6f5e8666 req-9a3c9b66-0749-42ef-96e8-5b5cfbb1d86b service nova] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 864.162589] env[66919]: INFO networking_nsxv3.common.synchronization [req-72a9f7eb-6c38-404d-b812-4ffe6f5e8666 req-9a3c9b66-0749-42ef-96e8-5b5cfbb1d86b service nova] Enqueued Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 864.163321] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 864.163321] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 864.164036] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 864.164036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.164036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.165153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.165380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.165476] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.166524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.166658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.166741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.167052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.167366] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.167907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.167907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.167907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.167907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.167907] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.172218] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.172218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.172218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.172218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.172218] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff06e7c-0fbc-4ec7-b896-c219d07c1831',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.395055] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.513264] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.513423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.513495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.513708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.513876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.513994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.514096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.514232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.514322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.514409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.514556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.514648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.514742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.514844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.514979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.515082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.515140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.515273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.515344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.515424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.515513] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.558618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.558764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.558835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.559081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.559177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.559613] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed already deleted. [ 864.559613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.674119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.674119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.674119] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.674946] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with status ACTIVE [ 864.675052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.675167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.675231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.675430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.675627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.676059] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.676059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.676059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.676059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.676205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.676276] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.677031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.677031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.677031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.677031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.677031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 is going to be updated. [ 864.700595] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.700887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.701082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.701239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.701420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.701577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.899569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.899569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.899569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.899754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.900468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.900468] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 864.936546] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.936761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.936847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.937226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.937226] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.947402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 865.017979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 068fbd14-1f23-4a8c-9eb8-6b8df298f30d: rpc.has_security_group_logging(os_id): False [ 865.039499] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.039986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.039986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.039986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.040208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.040316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.040416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.040475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.040634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.040711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.040908] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.041013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.041081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.041222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.041304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.041482] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.041574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.043719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.043719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.043808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.043916] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be updated. [ 865.105732] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.105732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.105732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.105732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.105732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.122125] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 865.179087] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.402361] env[66919]: INFO networking_nsxv3.common.synchronization [req-1c8f1b5b-f63e-4913-bd8b-69160e53632e req-036f20d8-0bd6-4eee-8c9a-53958aaa8e27 tempest-DeleteServersAdminTestJSON-765803948 tempest-DeleteServersAdminTestJSON-765803948-project-member] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 865.402899] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 865.403227] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.403340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.403400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.403664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.403875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.403953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.404035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.404231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.404327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.404683] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.682289] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.682432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.682432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.682603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.682697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.682848] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be created. [ 865.714241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.716018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.716018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.716018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.716018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.727479] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: UNINITIALIZED for 2s [ 865.807050] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.807398] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.807717] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.808113] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.808453] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.808649] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.808817] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.811976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.811976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.811976] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.811976] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 865.811976] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 865.811976] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 865.811976] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 865.811976] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 865.811976] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 865.834094] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 865.834094] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 865.834094] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 865.834094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.834094] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-c21ee67e-2207-41ed-8b7d-188bfbed1227 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.834094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.834094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.834094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.834532] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21ee67e-2207-41ed-8b7d-188bfbed1227',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.909064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.909064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.909064] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 already deleted. [ 865.909064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.337291] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.337692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.337692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.337836] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.338444] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.338444] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port c21ee67e-2207-41ed-8b7d-188bfbed1227 not found, creating... [ 866.338609] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.338814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.338885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.339115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.339288] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.339586] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.339768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.339894] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.340143] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.340278] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.340428] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: c21ee67e-2207-41ed-8b7d-188bfbed1227 is going to be created. [ 866.364056] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.364328] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.364420] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.365178] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.365597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.365681] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.964643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 866.965017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.965301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.965621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.965995] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.966217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.966768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.966768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.966768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.967332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.967509] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.126268] env[66919]: INFO networking_nsxv3.common.synchronization [req-1c8f1b5b-f63e-4913-bd8b-69160e53632e req-ab330767-8d15-4203-b548-4b3bbc338f90 service nova] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_rules [ 867.126649] env[66919]: INFO networking_nsxv3.common.synchronization [req-1c8f1b5b-f63e-4913-bd8b-69160e53632e req-ab330767-8d15-4203-b548-4b3bbc338f90 service nova] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 867.126987] env[66919]: INFO networking_nsxv3.common.synchronization [req-1c8f1b5b-f63e-4913-bd8b-69160e53632e req-ab330767-8d15-4203-b548-4b3bbc338f90 service nova] Enqueued Resource ID: c21ee67e-2207-41ed-8b7d-188bfbed1227 with Priority: HIGHEST for action port [ 867.127652] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_rules [ 867.127986] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 867.128296] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c21ee67e-2207-41ed-8b7d-188bfbed1227 with Priority: HIGHEST for action port [ 867.130525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.130525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.130525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.130525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.130525] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.132148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.132395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.132616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.132885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.133515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.133515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.133515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.133515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.133723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.133723] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.134856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-c21ee67e-2207-41ed-8b7d-188bfbed1227 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.134964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.135523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.135523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.135523] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21ee67e-2207-41ed-8b7d-188bfbed1227',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.143551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 867.143755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.470967] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.471272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.471272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.471475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.471649] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.471826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.471826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.471944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.472038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.472462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.472462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.472462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.472591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.472628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.472748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.472869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.472919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.473953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.473953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.473953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.473953] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.638694] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.639028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.639142] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.640955] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c21ee67e-2207-41ed-8b7d-188bfbed1227 with status ACTIVE [ 867.641265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.641517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.641517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.641774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.641910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.642177] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.642299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.642299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.643038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.643038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.643038] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.643038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.643292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.643292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.643407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.643555] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c21ee67e-2207-41ed-8b7d-188bfbed1227 is going to be updated. [ 867.672840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.673017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.673063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.673328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.673556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.673747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c21ee67e-2207-41ed-8b7d-188bfbed1227" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.741075] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 867.741075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.741075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.741075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.741361] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.741419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.741450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.741930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.742100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.742224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.742456] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.975826] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c800be9-5a1f-4e7d-acfb-e24947683dc0: rpc.has_security_group_logging(os_id): False [ 867.998659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.998896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.000678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.000678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.000678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.000892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.000892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.000944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.001623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.001623] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.001623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.001623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.001817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.001817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.002470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.002470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.002470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.002470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.002470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.002470] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 868.083490] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.083721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.083776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.084035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.084202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.103584] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 868.141836] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.245662] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.245825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.246127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.246208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.246364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.246468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.246528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.246673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.247463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.247463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.247463] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.247463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.247463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.247463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.247463] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.247806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.247806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.247806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.247882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.247909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.248112] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.573199] env[66919]: INFO networking_nsxv3.common.synchronization [req-a1492a74-f4a2-4739-8002-4785d1d87e60 req-73aff8a8-afa9-4126-b047-03d9173e4a06 tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 868.573842] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 868.575696] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.576023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.576695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.576695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.576815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.577519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.577519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.577519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.577519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.577519] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.644558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.644725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.644801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.645067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.645166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.645269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be created. [ 868.674984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.675233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.675311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.675554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.675738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.680254] env[66919]: INFO networking_nsxv3.common.synchronization [req-946fb830-98c8-4739-a5f5-63ab1b34ee7f req-202020b7-869e-49e5-8c0d-e6af15b6a4e3 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 868.680896] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 868.681280] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.681428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.681516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.681781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.682012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.682210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.682322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.682560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.682683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.682825] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.689920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: UNINITIALIZED for 2s [ 868.751236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 868.771275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.771494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.771494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.771717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.771808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.772014] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.772120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.772185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.772345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.772420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.772631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.772728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.772784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.772929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.773028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.773234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.773339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.773400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.773643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.773741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.773844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be created. [ 868.857741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.857939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.857986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.859089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.859089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.873841] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 869.082951] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.187302] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.187302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.187302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.187302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.220596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.220969] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.221390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.221771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.222137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.222339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.222583] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be updated. [ 869.294631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.294836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.294929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.297674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.297674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.308828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 869.586052] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.088837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.089556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.089556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.090656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.090656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.090656] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 870.121051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 870.121051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.127126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.127126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.127126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.127126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.127126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.138462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 870.700507] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 870.700507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.701135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.701135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.701135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.701253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.701294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.701842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.701842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.701842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.701842] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.888812] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 870.888812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.208822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.208822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.208822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.208822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.208822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.209660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.209660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.209660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.209660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.209660] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.318779] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 871.319017] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 deletion is rescheduled due to dependency. [ 871.319176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.715324] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5116cc0e-6bd6-420e-8fb5-142b35508ce3: rpc.has_security_group_logging(os_id): False [ 871.734837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.735068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.735068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.736715] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.736715] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.736715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.737082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.737082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.737082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.737164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.737784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.737784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.737784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.737784] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be created. [ 871.814975] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.815223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.815336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.815629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.815894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.829846] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 872.151403] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 872.151403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.641785] env[66919]: INFO networking_nsxv3.common.synchronization [None req-dffb3ed2-2519-4dd3-ac3f-7a203b9956cf None None] Enqueued Resource ID: deaf6ee3-d32a-4d5d-85c1-c9a923023b6e with Priority: HIGHEST for action port [ 873.642445] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deaf6ee3-d32a-4d5d-85c1-c9a923023b6e with Priority: HIGHEST for action port [ 873.643717] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-deaf6ee3-d32a-4d5d-85c1-c9a923023b6e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.643971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deaf6ee3-d32a-4d5d-85c1-c9a923023b6e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.644073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deaf6ee3-d32a-4d5d-85c1-c9a923023b6e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.644346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deaf6ee3-d32a-4d5d-85c1-c9a923023b6e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.644483] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deaf6ee3-d32a-4d5d-85c1-c9a923023b6e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.849225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 873.849475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.147266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deaf6ee3-d32a-4d5d-85c1-c9a923023b6e [ 874.147266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.149401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.149488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.149722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.149819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.149922] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deaf6ee3-d32a-4d5d-85c1-c9a923023b6e already deleted. [ 874.150102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deaf6ee3-d32a-4d5d-85c1-c9a923023b6e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.258034] env[66919]: INFO networking_nsxv3.common.synchronization [None req-822efb80-b382-4b2c-9a0d-21890f9d5216 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 874.258808] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 874.259160] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.259277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.259343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.259689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.259689] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.423784] env[66919]: INFO networking_nsxv3.common.synchronization [None req-98c35043-9570-4af2-b36b-846fb8ede6f5 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 874.423784] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 874.423784] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.423784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.668569] env[66919]: INFO networking_nsxv3.common.synchronization [req-9b69203f-3c4e-4beb-a765-90f5f1ccf76b req-7a3f8edc-f040-4055-ad2c-9433eb93ffc8 tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 874.669576] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 874.669937] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.670308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.670405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.670636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.670983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.671140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.671220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.671430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.671580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.671757] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.785199] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.785357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.785412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.785584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.785672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.785771] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b already deleted. [ 874.785920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.786097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.786261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.786342] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.175057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.175236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.175311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.175532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.175623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.175847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.175947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.176040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.176233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.176330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.176419] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 875.206297] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.206508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.206579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.206944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.207175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.217809] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 875.313850] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.314038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.314112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.314325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.314408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.314504] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b already deleted. [ 875.314585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.804318] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 875.804683] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 875.805876] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 875.805876] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 875.805876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.806546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.806721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.807256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.807370] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.807938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.807938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.807938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.808208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.808208] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.810229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.810420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.810560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.810886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.811152] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.811321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.811422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.811665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.811807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.811962] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.871471] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 875.871661] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 875.871798] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_rules [ 875.871931] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 875.872074] env[66919]: INFO networking_nsxv3.common.synchronization [req-310a63dd-45fd-4872-a20d-8aac234bfc18 req-17cfee20-e9fe-463e-bb4f-6055f48250d3 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 875.872700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 875.872848] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_rules [ 875.872952] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 875.873046] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 875.873136] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 875.873425] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.873605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.873605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.873814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.874010] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.875076] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.875246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.875393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.875674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.875762] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.878537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.878669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.878709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.878994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.879095] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff06e7c-0fbc-4ec7-b896-c219d07c1831',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.880184] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.880965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.881218] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.881334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.315911] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.317244] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.379604] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.379797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.382607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.382807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.383132] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with status ACTIVE [ 876.383386] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.383595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.385852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.386357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.386357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.386689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.386862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.387036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.387438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.387603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.388024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.388301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.388407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.388723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.388814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.388942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 is going to be updated. [ 876.402356] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ccce0cf2-f636-41f9-aa3e-ff7dca42cdad None None] Enqueued Resource ID: 4ac16793-0c23-4747-a488-edbc5ae08132 with Priority: HIGHEST for action port [ 876.403134] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ac16793-0c23-4747-a488-edbc5ae08132 with Priority: HIGHEST for action port [ 876.403764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ac16793-0c23-4747-a488-edbc5ae08132 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.403764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ac16793-0c23-4747-a488-edbc5ae08132" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.403911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ac16793-0c23-4747-a488-edbc5ae08132" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.404265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ac16793-0c23-4747-a488-edbc5ae08132" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.404383] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ac16793-0c23-4747-a488-edbc5ae08132',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.425028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.425276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.425406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.425919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.426085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.426273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.680749] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 876.680749] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 876.680749] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 876.681030] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 876.681082] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 876.681169] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 876.681505] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.681623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.681835] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.682421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.682421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.682421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.682421] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.682617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.682617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.683441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.683441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.683441] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.684571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.684571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.734637] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 876.735137] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 876.736031] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_rules [ 876.736031] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 876.736031] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_rules [ 876.736031] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 876.736220] env[66919]: INFO networking_nsxv3.common.synchronization [req-41938f17-cea3-4c49-896d-fbce76ad2b4c req-52b50052-e783-4c9c-adcb-4896961c01b6 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 876.737132] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 876.737212] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_rules [ 876.737354] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 876.737470] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with Priority: HIGHEST for action port [ 876.737589] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_rules [ 876.737709] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 876.737836] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 876.738371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.738513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.738903] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.739606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.739606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.739606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.739606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.739606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.739848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.739955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.740088] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ff06e7c-0fbc-4ec7-b896-c219d07c1831',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.741343] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.741594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.741594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.741748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.741829] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.742803] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.742921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.743137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.743232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.821253] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.822661] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.908659] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ac16793-0c23-4747-a488-edbc5ae08132 [ 876.908659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.908659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.908659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.908659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.908888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.908888] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ac16793-0c23-4747-a488-edbc5ae08132 already deleted. [ 876.909799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ac16793-0c23-4747-a488-edbc5ae08132" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.189710] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.213429] env[66919]: INFO networking_nsxv3.common.synchronization [req-b259fab5-afa0-447c-abc6-b3dce782c27d req-e0142331-5939-4927-8f7f-36c8f1c0d885 tempest-DeleteServersAdminTestJSON-1383032141 tempest-DeleteServersAdminTestJSON-1383032141-project-admin] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 877.213916] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 877.215723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.215723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.215723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.215723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.215723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.215949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.216166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.216372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.216487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.216603] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.228705] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 4s [ 877.245612] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 with status ACTIVE [ 877.245866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.246008] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.246101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.246338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.246432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.246614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.246714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.246782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.246934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.247022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.247204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.247299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.247369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.247512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.247586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.247671] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ff06e7c-0fbc-4ec7-b896-c219d07c1831 is going to be updated. [ 877.249438] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.249660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.270501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.270687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.270788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.271034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.271193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.271434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ff06e7c-0fbc-4ec7-b896-c219d07c1831" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.324752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.324910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.324968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.325216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.325349] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be created. [ 877.326795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.326795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.326907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.327075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.327168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.327338] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 877.367861] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.371278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.371392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.371678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.371986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.377691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.377878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.377974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.378251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.378446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.391494] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: UNINITIALIZED for 2s [ 877.396523] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 877.692212] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.721062] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.721062] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.721062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.721062] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be updated. [ 877.751836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.751986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.752053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.754629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.754629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.765097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 878.194923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.195237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.195237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.195492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.195580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.195618] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 is going to be created. [ 878.226835] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.226835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.226835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.226835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.226835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.235371] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: UNINITIALIZED for 2s [ 879.244226] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 879.244609] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc deletion is rescheduled due to dependency. [ 879.245353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.403544] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 879.403772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.404099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.405293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.405293] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.405293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.405293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.405293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.405293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.405293] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.406594] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 879.406677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.406794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.406957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.407126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.407229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.407290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.407430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.407496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.407966] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.775157] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 879.775157] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 deletion is rescheduled due to dependency. [ 879.775157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.909379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.910717] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.247391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: SUCCESS [ 880.247697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.248294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.248598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.248828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.249020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.249103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.249304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.249421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.249572] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.413168] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.414339] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.753226] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.919750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.919959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.920295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.920295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.920448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.920536] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 880.922629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.922629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.922629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.922629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.922840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.922840] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be updated. [ 880.957080] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.957208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.957270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.957476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.960031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.961829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.962565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.962565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.962565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.962565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.974798] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 880.975539] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 881.068651] env[66919]: INFO networking_nsxv3.common.synchronization [req-0126760e-01c6-4568-91ba-9b0db5b756e8 req-b7953757-25a8-4a9f-8f9c-e6f97aef1e81 tempest-ServersAdminNegativeTestJSON-847607459 tempest-ServersAdminNegativeTestJSON-847607459-project-member] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 881.069245] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 881.069599] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.069750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.069854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.070365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.070427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.070590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.070797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.070797] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.257176] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.577148] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.760777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.760945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.761320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.761320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.761417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.761449] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 is going to be updated. [ 881.791895] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.792123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.792240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.792543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.792718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.804263] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: IN_PROGRESS for 2s [ 882.078683] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.581873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.583398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.583398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.583398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.583398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.583398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 882.614059] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.614059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.614059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.614059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.614059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.629171] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 882.988893] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 882.989146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.989319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.989531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.989720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.989835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.989900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.990067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.990294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.990294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.990374] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.991854] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 882.992053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.992198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.992360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.992524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.992627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.992691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.992836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.992931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.993035] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.993836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.994013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.994190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.994290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.994354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.994493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.994568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.994647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.994732] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.995672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.995836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.995987] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.996100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.996165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.996305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.996379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.996460] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.081280] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-588 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.081681] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.081742] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.082325] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.082854] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.082966] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.083124] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.083451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.083741] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.084020] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.084149] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.084279] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.084388] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.084505] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.084675] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.084890] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.127592] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.127802] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.127898] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.128148] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-588" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.128595] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-7973bd65-5921-4b70-ba51-2c2280eda717 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.128708] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.128830] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.129124] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.129263] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7973bd65-5921-4b70-ba51-2c2280eda717',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.496158] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.497277] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.498269] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.498383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.498518] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.637243] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.637551] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.637608] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.638057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.638224] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.638544] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.638705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.638842] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.639781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.639781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.639781] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.639781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.639781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.640028] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.640130] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.640288] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 7973bd65-5921-4b70-ba51-2c2280eda717 is going to be updated. [ 883.665851] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.665989] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.666130] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.666391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.666578] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.666833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.818134] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: SUCCESS [ 883.818134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.818134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.818134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.818134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.818134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.818703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.818703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.818703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.818703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.818883] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.999525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a: rpc.has_security_group_logging(os_id): False [ 884.003357] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.004628] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.023398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.023613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.023613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.024572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.024572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.024572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.024572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.024572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.024838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.024927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.025032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be created. [ 884.089451] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.089451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.089568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.089757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.089954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.107106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 884.325537] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.502725] env[66919]: INFO networking_nsxv3.common.synchronization [req-7fd0bea2-4b2c-4fab-89c1-e71778d06d1c req-5178b57c-6d6d-47de-a7c2-6b37745e0709 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 884.502831] env[66919]: INFO networking_nsxv3.common.synchronization [req-7fd0bea2-4b2c-4fab-89c1-e71778d06d1c req-5178b57c-6d6d-47de-a7c2-6b37745e0709 service nova] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 884.502951] env[66919]: INFO networking_nsxv3.common.synchronization [req-7fd0bea2-4b2c-4fab-89c1-e71778d06d1c req-5178b57c-6d6d-47de-a7c2-6b37745e0709 service nova] Enqueued Resource ID: 7973bd65-5921-4b70-ba51-2c2280eda717 with Priority: HIGHEST for action port [ 884.503651] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_rules [ 884.503817] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 884.503935] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7973bd65-5921-4b70-ba51-2c2280eda717 with Priority: HIGHEST for action port [ 884.504237] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.504321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.504447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.504638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.504772] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.505745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.505745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.505745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.505916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.506078] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.506187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.506224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.507830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.507830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.507830] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.508222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7973bd65-5921-4b70-ba51-2c2280eda717 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.508446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.508502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.508611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.508686] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7973bd65-5921-4b70-ba51-2c2280eda717',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.510474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.510624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.510624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.511884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.511884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.511884] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 884.512778] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.512778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.512778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.512778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.513234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.513348] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be updated. [ 884.544569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.544920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.544920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.545907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.545907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.547695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.547864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.547962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.548206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.548377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.560586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 884.561294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 884.637960] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 884.638284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.830276] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d72e45fa-d666-4664-a812-3413fb67c0b4: rpc.has_security_group_logging(os_id): False [ 884.853028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.853028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.853028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.853711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.853946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.854169] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 is going to be created. [ 884.920214] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.920214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.920361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.920483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.920655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.933133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: IN_PROGRESS for 2s [ 885.008970] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.010022] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7973bd65-5921-4b70-ba51-2c2280eda717 with status ACTIVE [ 885.010240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.010365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.010437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.010641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.010947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.010947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.011192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.011192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.011316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.011411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.011679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.011818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.011912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.012113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.012193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.012289] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7973bd65-5921-4b70-ba51-2c2280eda717 is going to be updated. [ 885.014341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.014471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.037175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.037322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.037441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.037629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.037727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.037894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7973bd65-5921-4b70-ba51-2c2280eda717" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.514941] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.017963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.018288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.018288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.018443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.018531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.018628] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 886.048709] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.048855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.048969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.049229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.049381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.063030] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 886.122204] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 886.122455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.122655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.122899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.122997] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.573391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 886.573948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.576025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.576025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.576025] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.578281] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 886.580293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.580293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.580293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.581175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.582436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.582436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.582436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.582436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.582595] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.630522] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.630647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.948063] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: SUCCESS [ 886.948373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.086457] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.089660] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.589319] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.591835] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.071365] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 888.071577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.071744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.071977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.072585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.072585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.072585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.072585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.072841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.072841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.072841] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.090697] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.090988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.091154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.091424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.091553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.091665] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 888.097019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.097019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.097019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.097019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.097019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.097019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be updated. [ 888.130573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.130763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.130875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.131172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.131384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.133834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.134029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.134183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.134403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.134626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.148276] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 888.149473] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 888.577107] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.577287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.577433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.577695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.577907] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.578186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.578284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.578487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.578612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.578709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.578866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.578960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.579031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.579177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.579315] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.579407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.579468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.579606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.579679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.579759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.579855] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.082930] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 54a8eb66-4aa1-440c-af86-e5e65121f69f: rpc.has_security_group_logging(os_id): False [ 889.110067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.110067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.110413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.110413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.110497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.110698] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.110790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.110827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.110959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.111065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.111288] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.111407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.111482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.111663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.111748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.111946] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.112058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.112115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.112266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.112324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.112403] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 889.208854] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.209102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.209102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.209403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.209566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.228383] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 889.505675] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.505675] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 890.164200] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 890.164646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.164646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.165061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.165169] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.165323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.165416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.165666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.165741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.165883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.166067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.166196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.166196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.166312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.166568] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.166568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.166817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.166817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.166926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.166961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.167031] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.168803] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 890.168882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.169071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.169212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.169382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.169483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.169543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.169765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.169765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.169868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.169917] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.672081] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 890.673627] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.694548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.694548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.694841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.694973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.695228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.695377] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.695490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.695555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.695912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.696010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.696277] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.696398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.696476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.696764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.697044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.697145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.697231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.697296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.697454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.697534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.697636] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 890.810234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.811126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.811126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.811126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.811126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.831491] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 891.176433] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a: rpc.has_security_group_logging(os_id): False [ 891.195810] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.196012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.196659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.196997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.196997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.197285] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.197392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.197452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.197617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.197709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.197787] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be updated. [ 891.245168] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 891.245406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.275311] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.275482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.275551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.275767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.275914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.292757] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 891.744383] env[66919]: INFO networking_nsxv3.common.synchronization [req-e9bf9825-d8bd-44bb-9d95-22962242bbe4 req-c5088581-f15a-4ef5-859e-39c9bc9ff30a tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 891.745054] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 891.745474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.745661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.745752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.746063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.746255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.746362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.746429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.746637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.746757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.746866] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.128816] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.129056] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.129203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.129545] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.131110] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.131344] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.131472] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.131718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.131872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.132113] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.132206] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.132317] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.132419] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.132526] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.132630] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.132775] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.157455] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.157533] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.157672] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.157808] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.158224] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-176f804e-2c8d-42cf-88df-0feec48cd56a taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.158432] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.158547] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.160365] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.160674] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('176f804e-2c8d-42cf-88df-0feec48cd56a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.249250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.249521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.249521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.252229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.253204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.253204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.253204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.253204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.253204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.253204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.253622] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 already deleted. [ 892.253622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.664055] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.664055] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.664325] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.664496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.664729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.664729] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 176f804e-2c8d-42cf-88df-0feec48cd56a not found, creating... [ 892.664986] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.665223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.665418] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.665774] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.665941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.666294] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.666453] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.666623] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.666794] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.666914] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.667091] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 176f804e-2c8d-42cf-88df-0feec48cd56a is going to be created. [ 892.692783] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.693166] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.693325] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.693689] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.694094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.694362] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.860072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 892.860154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.860322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.860541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.860625] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.112347] env[66919]: INFO networking_nsxv3.common.synchronization [req-d6f3577c-d32f-44b6-9860-cd13ffadbc43 req-ee03b7df-31a9-478f-b611-17a163b316f1 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 893.113042] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 893.113497] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.113615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.113929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.114055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.114248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.114383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.115068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.115068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.115068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.115068] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.309785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 893.310125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.363718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.363832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.364154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.364262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.364535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.364535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.364535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.365738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.365738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.365738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.365738] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.547855] env[66919]: INFO networking_nsxv3.common.synchronization [req-e9bf9825-d8bd-44bb-9d95-22962242bbe4 req-b76203ce-6dad-406d-823b-b0c360e85ca5 service nova] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 893.548187] env[66919]: INFO networking_nsxv3.common.synchronization [req-e9bf9825-d8bd-44bb-9d95-22962242bbe4 req-b76203ce-6dad-406d-823b-b0c360e85ca5 service nova] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 893.548355] env[66919]: INFO networking_nsxv3.common.synchronization [req-e9bf9825-d8bd-44bb-9d95-22962242bbe4 req-b76203ce-6dad-406d-823b-b0c360e85ca5 service nova] Enqueued Resource ID: 176f804e-2c8d-42cf-88df-0feec48cd56a with Priority: HIGHEST for action port [ 893.548956] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_rules [ 893.549875] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 893.549875] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 176f804e-2c8d-42cf-88df-0feec48cd56a with Priority: HIGHEST for action port [ 893.549875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.549875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.550497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.550985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.551804] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.552331] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.552511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.552679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.552823] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.552912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.552970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.553227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.553331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.553421] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.554556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-176f804e-2c8d-42cf-88df-0feec48cd56a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.554556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.554556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.554784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.554784] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('176f804e-2c8d-42cf-88df-0feec48cd56a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.617463] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.867364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.867364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.867364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.867524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.867699] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.867964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.868078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.868255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.868339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.868426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.868576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.868660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.868721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.868858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.869024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.869125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.869199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.869331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.869418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.869497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.869581] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.060039] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.060039] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.060039] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 176f804e-2c8d-42cf-88df-0feec48cd56a with status ACTIVE [ 894.060039] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.060039] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.060039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.060836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.060836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.060836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.060836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.060836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.061154] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 176f804e-2c8d-42cf-88df-0feec48cd56a is going to be updated. [ 894.087705] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.089195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.089195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.089195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.089195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.089195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-176f804e-2c8d-42cf-88df-0feec48cd56a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.121767] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.372184] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 894.502623] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.502623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.502623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.502623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.502861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.503109] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.503267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.503474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.503612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.503705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.503943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.504045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.504112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.504287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.504345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.504536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.504623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.504881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.504881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.504881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.505646] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 894.563152] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.589809] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.590026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.590104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.590354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.590809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.615009] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 894.626691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.627816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.627816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.627816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.627816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.627816] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 894.668438] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.668646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.668721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.668935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.669339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.697474] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 894.708231] env[66919]: INFO networking_nsxv3.common.synchronization [req-842ad2bc-01fa-44a8-b325-f27394839ff6 req-13f24113-b4c5-47c4-8d82-14849f355e8e tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 894.711188] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 894.712161] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.712161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.712161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.712441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.716197] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.716332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.716332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.716561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.716693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.716829] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.066512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.069024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.069024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.069024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.069024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.069024] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 is going to be created. [ 895.100854] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.100854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.100854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.100854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.100854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.114211] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: UNINITIALIZED for 2s [ 895.138041] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.138364] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.138528] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.138944] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.139255] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.139600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.139898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.140604] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.140895] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.141174] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.144426] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.144668] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.144807] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.144932] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.145063] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.145358] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.168942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.169140] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.169285] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.169622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.170237] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-829873d8-2298-4dfd-8b43-b67b0be01962 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.170237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.170237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.170650] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.170976] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('829873d8-2298-4dfd-8b43-b67b0be01962',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.222301] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.674111] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.674734] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.674734] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.674941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.675103] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.675315] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 829873d8-2298-4dfd-8b43-b67b0be01962 not found, creating... [ 895.675670] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.675909] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.676074] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.676377] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.676523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.676871] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.677072] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.677232] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.677563] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.677756] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.677943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 829873d8-2298-4dfd-8b43-b67b0be01962 is going to be created. [ 895.725230] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.728483] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.729879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.729879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.729879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.729879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.729879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.226916] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.227121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.227162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.227358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.227448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.227563] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 896.262689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.262689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.262689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.263067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.263219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.274388] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 896.521812] env[66919]: INFO networking_nsxv3.common.synchronization [req-842ad2bc-01fa-44a8-b325-f27394839ff6 req-789ac7c1-278b-461d-80cd-125431d99507 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 896.522066] env[66919]: INFO networking_nsxv3.common.synchronization [req-842ad2bc-01fa-44a8-b325-f27394839ff6 req-789ac7c1-278b-461d-80cd-125431d99507 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 896.522275] env[66919]: INFO networking_nsxv3.common.synchronization [req-842ad2bc-01fa-44a8-b325-f27394839ff6 req-789ac7c1-278b-461d-80cd-125431d99507 service nova] Enqueued Resource ID: 829873d8-2298-4dfd-8b43-b67b0be01962 with Priority: HIGHEST for action port [ 896.522961] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 896.525814] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 896.525814] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 829873d8-2298-4dfd-8b43-b67b0be01962 with Priority: HIGHEST for action port [ 896.525980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.526076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.526184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.526487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.526731] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.528121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.528285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.528988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-829873d8-2298-4dfd-8b43-b67b0be01962 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.529068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.529123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.529351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.529480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('829873d8-2298-4dfd-8b43-b67b0be01962',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.636290] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 896.636697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.710451] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 896.710937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.034455] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 829873d8-2298-4dfd-8b43-b67b0be01962 with status ACTIVE [ 897.034455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.034455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.034455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.036499] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.036499] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.036499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.036499] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 829873d8-2298-4dfd-8b43-b67b0be01962 is going to be updated. [ 897.039222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.039222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.062585] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.062751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.062882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.063177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.063324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.063484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-829873d8-2298-4dfd-8b43-b67b0be01962" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.125817] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: SUCCESS [ 897.126067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.126243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.126454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.126647] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.126764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.126828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.129201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.129201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.129201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.129201] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.631732] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.134498] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a87b0710-8423-4a57-8221-4ad054db58d7: rpc.has_security_group_logging(os_id): False [ 898.154499] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.154647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.154744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.154934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.155084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.155310] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.155434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.155489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.155681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.155757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.155844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 is going to be created. [ 898.235525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.235812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.235812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.235970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.236371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.254634] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: IN_PROGRESS for 2s [ 898.285603] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 898.285839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.286124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.286348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.286550] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.286667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.286732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.286889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.286970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.287129] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.789572] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.292992] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.799929] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.799929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.799929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.799929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.799929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.799929] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 899.833126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.833126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.833126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.833126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.833126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.844861] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 900.272518] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: SUCCESS [ 900.272657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.526356] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 901.526661] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 901.856467] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 901.856736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.856946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.857241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.857451] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.857597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.857674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.857873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.857989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.858093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.858189] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.361569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.361744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.361821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.362222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.362307] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.362397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.362458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.362648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.362780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.362926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.363155] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.365048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.365048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.365048] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.871431] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 902.890348] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.890510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.890583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.890828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.911933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.913084] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.913245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.913320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.914041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.914041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.914041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.914041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.914041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.914349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.914349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.914461] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.914559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.914620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.914765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.914839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.914927] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 903.008915] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.009055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.009988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.009988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.009988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.024957] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 904.480040] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f3f1f24-1ef7-405c-b381-f5dda21b66ef req-6f95c730-e8a6-4c74-b0ab-7d2b71f02b4b tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 904.480040] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 904.480040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.480040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.480040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.480040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.481079] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.481079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.481079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.481079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.481079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.481079] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.874537] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.875113] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.875346] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.876057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.876148] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.877207] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.877207] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.877207] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.877207] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.877363] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.877395] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.877501] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.877608] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.877718] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.877849] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.877974] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.899473] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.899646] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.899784] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.899957] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.900299] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.900482] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.900619] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.901037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.901180] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10b8acdc-5b4b-46cf-9dd9-ad11618afa15',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.984680] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.039657] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 905.040037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.256219] env[66919]: INFO networking_nsxv3.common.synchronization [None req-19b3863e-b518-413c-84d7-795a6ed359ab None None] Enqueued Resource ID: d6262f96-316d-4cef-bb37-1c4b7e4acecd with Priority: HIGHEST for action port [ 905.256421] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6262f96-316d-4cef-bb37-1c4b7e4acecd with Priority: HIGHEST for action port [ 905.256740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6262f96-316d-4cef-bb37-1c4b7e4acecd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.256895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6262f96-316d-4cef-bb37-1c4b7e4acecd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.256954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6262f96-316d-4cef-bb37-1c4b7e4acecd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.257289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6262f96-316d-4cef-bb37-1c4b7e4acecd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.257289] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6262f96-316d-4cef-bb37-1c4b7e4acecd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.403309] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.403644] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.403750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.404082] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.404144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.404288] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 not found, creating... [ 905.404551] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.404703] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.404817] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.405045] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.405214] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.405479] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.405664] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.405814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.406077] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.408395] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.408622] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 is going to be created. [ 905.433163] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.433431] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.433539] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.433860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.434126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.434366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.487223] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.760828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d6262f96-316d-4cef-bb37-1c4b7e4acecd [ 905.761431] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.761712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.762445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.762445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.762445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.762445] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d6262f96-316d-4cef-bb37-1c4b7e4acecd already deleted. [ 905.762445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6262f96-316d-4cef-bb37-1c4b7e4acecd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.990111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.990215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.990215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.991377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.991377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.991377] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 906.036354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.036354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.036354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.036569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.036778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.050294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 906.134575] env[66919]: INFO networking_nsxv3.common.synchronization [req-960b4031-fd83-46fe-8bae-7ecb57972165 req-2bb4fc72-51e8-41e7-a85a-2d691c95dc5f tempest-ServersTestManualDisk-1328103097 tempest-ServersTestManualDisk-1328103097-project-member] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 906.134575] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGHEST for action security_group_members [ 906.134575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.134575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.134575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.134986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.134986] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.210794] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f3f1f24-1ef7-405c-b381-f5dda21b66ef req-7cc5b546-c7e0-4413-9dc7-8c00c9163914 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 906.210794] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f3f1f24-1ef7-405c-b381-f5dda21b66ef req-7cc5b546-c7e0-4413-9dc7-8c00c9163914 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 906.210908] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f3f1f24-1ef7-405c-b381-f5dda21b66ef req-7cc5b546-c7e0-4413-9dc7-8c00c9163914 service nova] Enqueued Resource ID: 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 with Priority: HIGHEST for action port [ 906.212700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 906.212700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 906.212700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 with Priority: HIGHEST for action port [ 906.212700] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.212700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.212700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.212700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.212700] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.213756] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.213860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.215469] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.215469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.215469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.215469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.215469] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10b8acdc-5b4b-46cf-9dd9-ad11618afa15',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.637155] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.637803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.641116] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.641116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.641116] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db is going to be updated. [ 906.671193] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.672600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.672682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.672916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.673078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.684707] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: IN_PROGRESS for 2s [ 906.717249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.717613] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 with status ACTIVE [ 906.717735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.717964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.718191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.718279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.718471] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.719024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.719024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.719024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.719024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.719024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.719253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.719253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.719355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.719434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.719657] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10b8acdc-5b4b-46cf-9dd9-ad11618afa15 is going to be updated. [ 906.745359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.745649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.745783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.746086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.746264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.746445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10b8acdc-5b4b-46cf-9dd9-ad11618afa15" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.848941] env[66919]: INFO networking_nsxv3.common.synchronization [req-f1e965d9-1297-494d-bf82-6bcd7ec06fa3 req-22fa1f23-a7e1-4f67-90f6-739148b74190 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 906.849525] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 906.849834] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.849951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.851083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.851386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.851555] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.851663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.851726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.851891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.852132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.852132] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.266425] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.266744] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.266892] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.267185] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.267453] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.267616] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.267732] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.267947] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.268322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.268587] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.268732] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.268866] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.269008] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.269156] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.269266] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.269399] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.298083] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.298272] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.298436] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.298621] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.299087] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.299382] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.299946] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.301176] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.301804] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b632dcf-f671-47b1-bd99-3bfd1a1f91a7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.357999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.359369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.359503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.359837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.359976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.360236] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.360407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.360478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.360652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.360761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.360859] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af639ee4-0cf3-4378-b556-ae5617090112 already deleted. [ 907.360952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.808804] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.808804] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 not found, creating... [ 907.808804] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.808804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.809980] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.810182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.813368] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.813368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.813550] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.814194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.814194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.814194] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 is going to be created. [ 907.834979] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.835898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.835898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.835898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.835898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.836191] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.060805] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 908.061091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.061262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.061486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.061685] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.061790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.061854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.062016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.062098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.062191] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.090549] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d3821185-91bc-4cd6-a881-8abdcd85cd08 None None] Enqueued Resource ID: dc53f8b6-0295-440a-a4e6-d50f58b4ab38 with Priority: HIGHEST for action port [ 908.090818] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc53f8b6-0295-440a-a4e6-d50f58b4ab38 with Priority: HIGHEST for action port [ 908.091402] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc53f8b6-0295-440a-a4e6-d50f58b4ab38 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.091533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc53f8b6-0295-440a-a4e6-d50f58b4ab38" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.095023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc53f8b6-0295-440a-a4e6-d50f58b4ab38" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.095023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc53f8b6-0295-440a-a4e6-d50f58b4ab38" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.095023] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc53f8b6-0295-440a-a4e6-d50f58b4ab38',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.565487] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.595087] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc53f8b6-0295-440a-a4e6-d50f58b4ab38 [ 908.595087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.595087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.595087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.595614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.595614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.595614] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc53f8b6-0295-440a-a4e6-d50f58b4ab38 already deleted. [ 908.595614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc53f8b6-0295-440a-a4e6-d50f58b4ab38" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.598772] env[66919]: INFO networking_nsxv3.common.synchronization [req-f1e965d9-1297-494d-bf82-6bcd7ec06fa3 req-1d3309e7-a6d0-41f9-8dca-307793ff0849 service nova] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 908.599755] env[66919]: INFO networking_nsxv3.common.synchronization [req-f1e965d9-1297-494d-bf82-6bcd7ec06fa3 req-1d3309e7-a6d0-41f9-8dca-307793ff0849 service nova] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 908.599755] env[66919]: INFO networking_nsxv3.common.synchronization [req-f1e965d9-1297-494d-bf82-6bcd7ec06fa3 req-1d3309e7-a6d0-41f9-8dca-307793ff0849 service nova] Enqueued Resource ID: 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 with Priority: HIGHEST for action port [ 908.599755] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_rules [ 908.599755] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 908.599999] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 with Priority: HIGHEST for action port [ 908.600735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.600859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.600927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.601161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.601209] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.602205] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.602324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.602401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.602558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.602704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.602795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.602858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.602997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.603091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.603181] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.603950] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.604031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.604095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.604240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.604312] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b632dcf-f671-47b1-bd99-3bfd1a1f91a7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.695472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db in Status: SUCCESS [ 908.695585] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db deletion is rescheduled due to dependency. [ 908.695714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.068828] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.106097] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.107454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.107593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.109334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 with status ACTIVE [ 909.109497] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.109625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.109688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.110040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.110040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.110210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.110274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.110875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.110875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.110875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.110875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.110875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.110875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.111168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.111168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.111225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b632dcf-f671-47b1-bd99-3bfd1a1f91a7 is going to be updated. [ 909.134669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.134888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.134947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.135190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.135339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.135744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b632dcf-f671-47b1-bd99-3bfd1a1f91a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.571998] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.571998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.571998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.572356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.572356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.572996] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 909.609614] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.613689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.613839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.613910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.614676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.615386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.627903] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 910.121543] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.121543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.121543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.121543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.121543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.121543] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af639ee4-0cf3-4378-b556-ae5617090112 is going to be created. [ 910.145510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.145510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.145773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.146140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.146438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.158903] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: UNINITIALIZED for 2s [ 910.397355] env[66919]: INFO networking_nsxv3.common.synchronization [req-f37b0fe4-68f8-4834-9f5c-3cf48b675453 req-1e723669-1c32-453c-bae7-5c9ef2f89e27 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 910.397559] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 910.398120] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.398448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.399040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.399483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.399838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.400198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.400437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.400908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.401156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.401361] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.903930] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.407553] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.639944] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 911.640146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.640316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.640467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.640668] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.640775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.640946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.641021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.642083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.642083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.642083] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.675396] env[66919]: INFO networking_nsxv3.common.synchronization [req-b7dca886-4df6-481a-9ce1-094a08c2cccf req-30607860-a35b-4631-83c1-b91c7fb999ca tempest-MigrationsAdminTest-842819955 tempest-MigrationsAdminTest-842819955-project-member] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 911.680069] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGHEST for action security_group_members [ 911.680069] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.680069] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.680069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.680069] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.914454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.914454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.914454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.914454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.914454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.914454] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 911.966562] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.966562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.966562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.966562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.967733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.980839] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 911.986580] env[66919]: INFO networking_nsxv3.common.synchronization [req-628afda9-362e-42bc-8090-8144d2382f96 req-6f16cc10-b125-44b9-be40-ad2db0ead2b9 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 911.987456] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 911.987847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.987978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.988042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.988376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.988538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.990148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.990148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.990148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.990148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.990148] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.144105] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.144296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.144375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.144659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.144837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.144942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.145015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.145179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.145268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.145423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.145619] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.145735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.145798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.145944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.146095] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.146187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.146247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.146384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.146459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.146540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.146628] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.171130] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: SUCCESS [ 912.171130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.171302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.171520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.171723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.171833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.171895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.172062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.172140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.172220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.172310] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.184906] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.184906] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.184906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.184906] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be updated. [ 912.216205] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.217338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.217338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.217338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.217944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.243352] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: IN_PROGRESS for 2s [ 912.403829] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.403829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.403829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.404135] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.404499] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.404656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.404851] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.405084] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.405244] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.405530] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.405981] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.405981] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.405981] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.406138] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.406175] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.406296] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.434024] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.434024] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.434024] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.434024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.434485] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-a656fcb1-ed30-4079-aa70-24b7f3828ffc taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.434485] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.434485] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.434733] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.435107] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a656fcb1-ed30-4079-aa70-24b7f3828ffc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.491532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.492564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.492564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.492564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.492564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.492853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.492853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.492962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.493068] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 already deleted. [ 912.493160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.650027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5: rpc.has_security_group_logging(os_id): False [ 912.677928] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.678154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.678241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.678522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.680269] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.710027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.710027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.710027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.710027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.710776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.710776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.710776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.710776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.710776] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 912.783915] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.784133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.784133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.784418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.784541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.802477] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 912.938875] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.938991] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.939115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.939428] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.939612] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.939785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port a656fcb1-ed30-4079-aa70-24b7f3828ffc not found, creating... [ 912.940117] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.940317] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.940660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.941023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.941209] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.941662] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.941865] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.941985] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.942279] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.942887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.942887] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: a656fcb1-ed30-4079-aa70-24b7f3828ffc is going to be created. [ 912.966278] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.966278] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.966932] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.966932] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.967347] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.967438] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.186619] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af639ee4-0cf3-4378-b556-ae5617090112: rpc.has_security_group_logging(os_id): False [ 913.209899] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.210216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.210216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.210472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.210472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.210724] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.210858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.210959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.211068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.211141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.211222] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af639ee4-0cf3-4378-b556-ae5617090112 is going to be created. [ 913.296567] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.296567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.296567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.296862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.297199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.322076] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: IN_PROGRESS for 2s [ 913.780821] env[66919]: INFO networking_nsxv3.common.synchronization [req-628afda9-362e-42bc-8090-8144d2382f96 req-9e08f1da-6b35-4398-82f8-7d95799e40ea service nova] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_rules [ 913.781111] env[66919]: INFO networking_nsxv3.common.synchronization [req-628afda9-362e-42bc-8090-8144d2382f96 req-9e08f1da-6b35-4398-82f8-7d95799e40ea service nova] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 913.781158] env[66919]: INFO networking_nsxv3.common.synchronization [req-628afda9-362e-42bc-8090-8144d2382f96 req-9e08f1da-6b35-4398-82f8-7d95799e40ea service nova] Enqueued Resource ID: a656fcb1-ed30-4079-aa70-24b7f3828ffc with Priority: HIGHEST for action port [ 913.781671] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_rules [ 913.781798] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 913.781890] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a656fcb1-ed30-4079-aa70-24b7f3828ffc with Priority: HIGHEST for action port [ 913.782180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.782338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.782429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.782910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.782910] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.783662] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.783747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.783786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.783971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.784090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.784370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.784370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.784370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.784483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.784540] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.785721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a656fcb1-ed30-4079-aa70-24b7f3828ffc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.785721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.785895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.785942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.786053] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a656fcb1-ed30-4079-aa70-24b7f3828ffc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.992337] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 913.992603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.259395] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd in Status: SUCCESS [ 914.259673] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd deletion is rescheduled due to dependency. [ 914.260018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.287698] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.289037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.289306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.289746] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a656fcb1-ed30-4079-aa70-24b7f3828ffc with status ACTIVE [ 914.289956] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.290124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.290214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.291260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.291260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.291684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.291684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.291684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.291786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.291814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.291896] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a656fcb1-ed30-4079-aa70-24b7f3828ffc is going to be updated. [ 914.323025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.323278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.323278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.323513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.323664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.324089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a656fcb1-ed30-4079-aa70-24b7f3828ffc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.792101] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.820261] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 914.820327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.886635] env[66919]: INFO networking_nsxv3.common.synchronization [req-cfb6aab5-93f6-48db-85c8-3273f32596a4 req-141559af-b7bd-4e60-aabb-ace1ece0dfa6 tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 914.887293] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 914.887648] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.888111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.888215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.888448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.888628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.888737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.888800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.888963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.889074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.889175] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.283363] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-555 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.283704] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.283793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.284088] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.284372] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.284525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.284648] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.285544] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.285794] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.286074] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.286255] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.286462] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.287039] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.287039] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.287039] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.287500] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.294129] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.294295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.294368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.294622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.294754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.294845] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be created. [ 915.312376] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.312626] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.312834] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.313036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-555" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.314449] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-d7753b1c-b78d-4861-83a7-046cb097e6f2 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.314692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.315978] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.315978] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.315978] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7753b1c-b78d-4861-83a7-046cb097e6f2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.323053] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.323053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.323053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.323053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.323053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.335935] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: UNINITIALIZED for 2s [ 915.337247] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: SUCCESS [ 915.337465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.391496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.391653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.391728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.391948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.392058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.392261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.392359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.392422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.392577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.392668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.392737] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed already deleted. [ 915.393224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.822757] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.822757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.822757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.822757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.822757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.822757] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port d7753b1c-b78d-4861-83a7-046cb097e6f2 not found, creating... [ 915.823316] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.823316] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.823441] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.823666] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.823793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.824111] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.824286] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.824420] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.824693] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.824906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.825187] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: d7753b1c-b78d-4861-83a7-046cb097e6f2 is going to be created. [ 915.861019] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.861019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.861019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.861019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.861019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.861019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.653822] env[66919]: INFO networking_nsxv3.common.synchronization [req-cfb6aab5-93f6-48db-85c8-3273f32596a4 req-347986d2-b155-47d6-8ba1-b0b66cc31eed service nova] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 916.654031] env[66919]: INFO networking_nsxv3.common.synchronization [req-cfb6aab5-93f6-48db-85c8-3273f32596a4 req-347986d2-b155-47d6-8ba1-b0b66cc31eed service nova] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 916.654167] env[66919]: INFO networking_nsxv3.common.synchronization [req-cfb6aab5-93f6-48db-85c8-3273f32596a4 req-347986d2-b155-47d6-8ba1-b0b66cc31eed service nova] Enqueued Resource ID: d7753b1c-b78d-4861-83a7-046cb097e6f2 with Priority: HIGHEST for action port [ 916.654887] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_rules [ 916.655029] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 916.655029] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7753b1c-b78d-4861-83a7-046cb097e6f2 with Priority: HIGHEST for action port [ 916.655406] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.655615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.655654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.655909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.655951] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.656901] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.657045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.657127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.657357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.657523] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.657623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.657673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.657822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.657909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.658011] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.659391] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7753b1c-b78d-4861-83a7-046cb097e6f2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.659580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.659580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.659910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.659910] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7753b1c-b78d-4861-83a7-046cb097e6f2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.163023] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.163023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.163467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.165139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7753b1c-b78d-4861-83a7-046cb097e6f2 with status ACTIVE [ 917.165139] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.165139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.165139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.165333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.165847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.165847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.165847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.165847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.166039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.166603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.166603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.166603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.166603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.167155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.167155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.167155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7753b1c-b78d-4861-83a7-046cb097e6f2 is going to be updated. [ 917.191057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.191057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.191057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.191057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.191057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.191057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7753b1c-b78d-4861-83a7-046cb097e6f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.349747] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 917.349993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.350239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.350428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.350640] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.350862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.350862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.351015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.351077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.351238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.351238] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.664089] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.703478] env[66919]: INFO networking_nsxv3.common.synchronization [req-15077086-aa6c-456a-9f9e-e3891d5c5b09 req-bc5cff48-effb-463a-bd3f-16549f8b2457 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 917.703918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 917.704046] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.704521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.704598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.704841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.704971] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.705085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.705148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.705321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.705441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.705582] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.854790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.855043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.855162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.855513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.855777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.855972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.856043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.859877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.859877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.859877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.863099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.863408] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.147890] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-994 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.148034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.148204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.149307] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.149307] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.149417] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.149590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.149949] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.150202] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.150611] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.150808] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 918.150967] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 918.151126] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 918.151301] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 918.151470] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 918.151652] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 918.167387] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.167751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.167751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.167855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.167945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.168062] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed is going to be created. [ 918.174087] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 918.174275] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 918.174413] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 918.174586] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-994" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.174898] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-060c35df-aa27-4bd7-a7df-f3fda6038e29 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.175103] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.175227] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.175654] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.175832] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('060c35df-aa27-4bd7-a7df-f3fda6038e29',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.197299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.197465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.197530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.197795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.197970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.208507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.208681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.210670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.210917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.211031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.211265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.211384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.211448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.211599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.211674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.211762] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be updated. [ 918.214872] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: UNINITIALIZED for 2s [ 918.241954] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.242222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.242222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.242407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.242551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.252326] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 918.390879] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de9ea36-57e3-4c37-a587-59d118b05d81: rpc.has_security_group_logging(os_id): False [ 918.410531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.410774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.410996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.411248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.411368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.411588] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.411776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.411851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.412116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.412271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.412629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.412767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.412876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.413110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.413321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.413638] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.413777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.413885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.414122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.414319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.414458] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be created. [ 918.530335] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.530497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.530671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.530832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.531027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.555896] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 918.679258] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.679881] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.680079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.680634] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.680920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.681114] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 060c35df-aa27-4bd7-a7df-f3fda6038e29 not found, creating... [ 918.681447] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.681821] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.682268] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.682725] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.682879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.683355] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.683566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.683663] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.683910] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.684080] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.684577] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 060c35df-aa27-4bd7-a7df-f3fda6038e29 is going to be created. [ 918.719478] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.720190] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.720412] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.720804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.721088] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.721407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.497700] env[66919]: INFO networking_nsxv3.common.synchronization [req-15077086-aa6c-456a-9f9e-e3891d5c5b09 req-264d798f-4ca7-4606-8d5f-50b772fa4ed5 service nova] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 919.497700] env[66919]: INFO networking_nsxv3.common.synchronization [req-15077086-aa6c-456a-9f9e-e3891d5c5b09 req-264d798f-4ca7-4606-8d5f-50b772fa4ed5 service nova] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 919.497700] env[66919]: INFO networking_nsxv3.common.synchronization [req-15077086-aa6c-456a-9f9e-e3891d5c5b09 req-264d798f-4ca7-4606-8d5f-50b772fa4ed5 service nova] Enqueued Resource ID: 060c35df-aa27-4bd7-a7df-f3fda6038e29 with Priority: HIGHEST for action port [ 919.498604] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_rules [ 919.498604] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 919.498604] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 060c35df-aa27-4bd7-a7df-f3fda6038e29 with Priority: HIGHEST for action port [ 919.498824] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.498824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.499053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.499266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.499366] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.500361] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.500491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.500691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-060c35df-aa27-4bd7-a7df-f3fda6038e29 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.500793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.500869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.501040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.501122] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('060c35df-aa27-4bd7-a7df-f3fda6038e29',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.004540] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.004686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.008206] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 060c35df-aa27-4bd7-a7df-f3fda6038e29 with status ACTIVE [ 920.009025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.009025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.009025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.009025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.009025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.009418] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.009418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.009418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.009580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.009660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.009865] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.009983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.010071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.010260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.010344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.010441] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 060c35df-aa27-4bd7-a7df-f3fda6038e29 is going to be updated. [ 920.035362] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.035583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.035630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.035841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.035979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.036181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-060c35df-aa27-4bd7-a7df-f3fda6038e29" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.227713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: UNINITIALIZED for 4s [ 920.268675] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 920.269231] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 deletion is rescheduled due to dependency. [ 920.269396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.269568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.269815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.270020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.270141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.270216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.270366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.270488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.270614] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.577390] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 920.577727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.773102] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.275657] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.778603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.778992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.778992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.779084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.779207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.779299] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be updated. [ 921.823058] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.823058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.823058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.823058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.823058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.835763] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 922.240779] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: SUCCESS [ 922.241027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.241235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.241545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.241790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.241913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.241997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.242187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.242285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.242377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.242472] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.744817] env[66919]: INFO networking_nsxv3.common.synchronization [req-528525be-5a6f-4752-934e-58e2ccd359e5 req-1cb2cc87-5e18-4501-8bbb-403c7e5be882 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 922.749861] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 922.749861] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.749861] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.749861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.749861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.749861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.749861] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.749861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.749861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.750409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.750780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.750780] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.122436] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.123043] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.123192] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.123549] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.123973] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.124172] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.124338] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.124602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.124749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.125016] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.125157] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 923.125302] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 923.125426] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 923.125505] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 923.125608] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 923.125742] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 923.145623] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 923.145810] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 923.145909] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 923.146433] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.146876] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.147108] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.147242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.147597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.147748] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c2a42c-a829-4365-85d0-f34d31f4cf7f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.252900] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f69e0f-ba18-45e6-aa72-789adc7ed5ed: rpc.has_security_group_logging(os_id): False [ 923.256210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.256425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.256425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.256997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.256997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.256997] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.256997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.257295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.257295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.257295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.257512] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b already deleted. [ 923.257512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.274424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.274424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.274606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.274696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.274943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.275049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.275116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.275344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.275420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.275508] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed is going to be created. [ 923.344734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.344953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.344953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.345216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.345545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.364449] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: IN_PROGRESS for 2s [ 923.650783] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.651080] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.651204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.651528] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.651693] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.651859] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port e0c2a42c-a829-4365-85d0-f34d31f4cf7f not found, creating... [ 923.652141] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.652300] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.652416] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.652687] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.652823] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.653152] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.653302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.653406] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.653636] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.653769] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.653935] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f is going to be created. [ 923.675922] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.676246] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.676395] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.676707] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.676953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.677227] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.848501] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 923.848787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.848868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.849101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.849322] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.849482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.849563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.849682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.849762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.849848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.849941] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.352460] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [req-528525be-5a6f-4752-934e-58e2ccd359e5 req-9923d8aa-b935-45ab-b68d-0801f18d36ae service nova] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [req-528525be-5a6f-4752-934e-58e2ccd359e5 req-9923d8aa-b935-45ab-b68d-0801f18d36ae service nova] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [req-528525be-5a6f-4752-934e-58e2ccd359e5 req-9923d8aa-b935-45ab-b68d-0801f18d36ae service nova] Enqueued Resource ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f with Priority: HIGHEST for action port [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 924.441763] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f with Priority: HIGHEST for action port [ 924.441763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.441763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.441763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.442460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.442460] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.444692] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.444819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.444898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.445518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.445518] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.445518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.445518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.445766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.445804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.445903] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.447123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.447123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.447123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.447401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.447401] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c2a42c-a829-4365-85d0-f34d31f4cf7f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.855557] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07ef1b9b-e982-41f7-a4f6-a3caf8809311: rpc.has_security_group_logging(os_id): False [ 924.876048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.876256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.876256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.876428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.876540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.876835] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.876954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.877034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.877286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.877365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.877592] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be updated. [ 924.942177] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.942389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.942454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.942664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.942811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.949939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.949939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.950112] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.955525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c2a42c-a829-4365-85d0-f34d31f4cf7f with status ACTIVE [ 924.959022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.959022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.959022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.959022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.959022] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f is going to be updated. [ 924.960179] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 924.981488] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.981610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.981694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.981897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.982177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.982259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.383694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: SUCCESS [ 925.384085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.452896] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.955882] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.956071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.956205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.956399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.956468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.956519] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be created. [ 925.980987] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.981166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.981242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.981447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.981665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.995758] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: UNINITIALIZED for 2s [ 926.974687] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 926.974687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.007295] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: SUCCESS [ 928.007636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.007691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.007919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.008139] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.008258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.008325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.008490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.008571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.008664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.008752] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.399837] env[66919]: INFO networking_nsxv3.common.synchronization [req-4b969042-6035-4475-bb3c-8c86cb30f8f6 req-06711b23-bae0-4f03-a9ae-3bbfa0d7d77c tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 928.400449] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 928.400765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.400899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.401266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.402801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.404193] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.404314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.404314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.405833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.405833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.405833] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.513217] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.907911] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.018104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482283b1-d8c6-448e-bbe8-ed71e10e6b6b: rpc.has_security_group_logging(os_id): False [ 929.040122] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.040274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.040343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.040559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.044041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.044041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.044041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.044041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.044041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.044041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.044041] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be created. [ 929.117025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.117199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.117376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.117699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.117904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.130961] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: IN_PROGRESS for 2s [ 929.410466] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.712534] env[66919]: INFO networking_nsxv3.common.synchronization [req-ddd00926-6cba-4a90-a08b-fc1730e5ba4a req-0a2cf664-5f48-4879-b25b-693cd087d1d8 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 929.713152] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 929.713541] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.713706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.713806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.714043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.714252] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.714395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.714491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.714673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.714792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.714913] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.793783] env[66919]: INFO networking_nsxv3.common.synchronization [req-8abde03f-6e90-43f2-94c7-57ab171a86fc req-4201e3fd-4f33-4981-bea7-0a23b00dc1be tempest-ServersAdminNegativeTestJSON-847607459 tempest-ServersAdminNegativeTestJSON-847607459-project-member] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 929.794537] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGHEST for action security_group_members [ 929.795083] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.795083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.795271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.795692] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.795829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.795918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.796133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.796298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.796433] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.915368] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.915523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.915594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.915857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.915956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.916012] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 929.949207] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.949352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.949425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.949635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.949774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.960401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 930.110604] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-43 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.110956] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.110956] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.111247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.111520] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.111692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.111819] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.112221] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.112221] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.112391] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.112515] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.112623] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.112729] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.112839] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.112944] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.113144] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.135770] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.135969] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.136231] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.136434] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-43" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.136770] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-86ef3b82-13c1-4e9d-b057-215011c1ec9b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.136966] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.137102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.137456] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.137591] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ef3b82-13c1-4e9d-b057-215011c1ec9b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.216903] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.299034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.299151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.299210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.299456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.299555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.299815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.299948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.300021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.300869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.302017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.302017] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be updated. [ 930.344683] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.344874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.345008] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.345285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.345424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.356288] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: IN_PROGRESS for 2s [ 930.640611] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.640611] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.640749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.641115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.641115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.641462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 86ef3b82-13c1-4e9d-b057-215011c1ec9b not found, creating... [ 930.641512] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.641659] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.641821] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.642086] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.642309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.642679] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.642847] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.643028] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.643240] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.643377] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.643520] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b is going to be created. [ 930.666741] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.667036] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.667116] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.667379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.667565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.667773] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.721649] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.155505] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: SUCCESS [ 931.155913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.224968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.225199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.225271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.225564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.226021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.226173] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 931.260551] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.260687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.260756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.260968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.261137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.270659] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 931.430242] env[66919]: INFO networking_nsxv3.common.synchronization [req-ddd00926-6cba-4a90-a08b-fc1730e5ba4a req-68802281-50b5-4733-8b05-ec2f4184b96e service nova] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 931.430485] env[66919]: INFO networking_nsxv3.common.synchronization [req-ddd00926-6cba-4a90-a08b-fc1730e5ba4a req-68802281-50b5-4733-8b05-ec2f4184b96e service nova] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 931.430666] env[66919]: INFO networking_nsxv3.common.synchronization [req-ddd00926-6cba-4a90-a08b-fc1730e5ba4a req-68802281-50b5-4733-8b05-ec2f4184b96e service nova] Enqueued Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 931.431243] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 931.431380] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 931.431477] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 931.431781] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.431893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.431957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.432635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.432635] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.433151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.433931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.433931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ef3b82-13c1-4e9d-b057-215011c1ec9b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.433931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.433931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.433931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.433931] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ef3b82-13c1-4e9d-b057-215011c1ec9b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.935874] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.935962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.936838] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ef3b82-13c1-4e9d-b057-215011c1ec9b with status ACTIVE [ 931.936838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.936838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.936967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.937223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.937394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.937701] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.937881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.938326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.938400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.938539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.939095] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.939095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.939260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.940035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.940035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.940035] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b is going to be updated. [ 931.964427] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.964427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.964427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.964427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.964427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.964904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.970604] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 931.970783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.371867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 in Status: SUCCESS [ 932.372260] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 deletion is rescheduled due to dependency. [ 932.372260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.482261] env[66919]: INFO networking_nsxv3.common.synchronization [req-b1afd892-4015-4e1e-a3f1-63d5d1b9fe89 req-78ff380b-a6b3-4288-be1a-6c1226e06f83 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 932.482850] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 932.483418] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.485528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.485641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.485911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.486119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.486257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.486324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.486541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.486656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.486771] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.954144] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.954144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.954144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.954144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.954144] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.954144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.954144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.954863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.955226] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.955585] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.955830] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.956464] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.959080] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.959080] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.959080] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.959080] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.983525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.983525] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.983525] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.983525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.983525] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-86a3fc1a-eee5-4289-ad04-e45ea668956d taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.983525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.983525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.983525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.983525] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a3fc1a-eee5-4289-ad04-e45ea668956d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.988954] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.992115] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.992115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.992115] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 933.029073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.029073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.029073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.029073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.029073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.040636] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 933.282026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 933.282268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.282439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.282662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.282846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.283089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.283194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.283287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.283369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.283463] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.480525] env[66919]: INFO networking_nsxv3.common.synchronization [req-71e95587-e54b-479e-91ed-ce1f90573e21 req-22ae9f8d-687c-4b22-8a44-6c9740c96b3a tempest-ServersNegativeTestJSON-918520820 tempest-ServersNegativeTestJSON-918520820-project-member] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 933.481226] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGHEST for action security_group_members [ 933.481584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.481724] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.481815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.482048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.482205] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.482306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.482381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.482832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.482978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.483115] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.486007] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.486105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.486249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.486473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.486622] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.486768] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 86a3fc1a-eee5-4289-ad04-e45ea668956d not found, creating... [ 933.487030] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.487195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.487313] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.487521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.487654] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.487945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.488139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.488257] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.488495] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.488630] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.488769] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 86a3fc1a-eee5-4289-ad04-e45ea668956d is going to be created. [ 933.526416] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.526646] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.526769] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.527063] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.527423] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.527561] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.786273] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.989249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.989249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.989249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.989249] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be updated. [ 934.028528] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.028736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.028777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.029053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.029233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.040261] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: IN_PROGRESS for 2s [ 934.280991] env[66919]: INFO networking_nsxv3.common.synchronization [req-b1afd892-4015-4e1e-a3f1-63d5d1b9fe89 req-0da21c49-dd58-4a1d-85f4-a6bcc536f0e0 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 934.281224] env[66919]: INFO networking_nsxv3.common.synchronization [req-b1afd892-4015-4e1e-a3f1-63d5d1b9fe89 req-0da21c49-dd58-4a1d-85f4-a6bcc536f0e0 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 934.281510] env[66919]: INFO networking_nsxv3.common.synchronization [req-b1afd892-4015-4e1e-a3f1-63d5d1b9fe89 req-0da21c49-dd58-4a1d-85f4-a6bcc536f0e0 service nova] Enqueued Resource ID: 86a3fc1a-eee5-4289-ad04-e45ea668956d with Priority: HIGHEST for action port [ 934.282356] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 934.282516] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 934.282617] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86a3fc1a-eee5-4289-ad04-e45ea668956d with Priority: HIGHEST for action port [ 934.282962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.283203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.283279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.285110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.285110] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.285396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.285396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.285599] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-86a3fc1a-eee5-4289-ad04-e45ea668956d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.285697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.285756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.285953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.286059] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86a3fc1a-eee5-4289-ad04-e45ea668956d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.288482] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.788852] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.789225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.790418] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86a3fc1a-eee5-4289-ad04-e45ea668956d with status ACTIVE [ 934.790616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.790736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.790804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.791031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.791124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.791304] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.791399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.791462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.791623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.791697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.791873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.791968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.792049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.792184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.792257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.792339] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86a3fc1a-eee5-4289-ad04-e45ea668956d is going to be updated. [ 934.793516] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.793626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.793694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.794015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.794137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.794229] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 934.835306] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.835306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.835306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.835526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.835526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.835781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86a3fc1a-eee5-4289-ad04-e45ea668956d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.838695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.838876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.838876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.839264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.839264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.854111] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 935.051533] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 935.051891] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 935.051977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.052118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.052311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.053033] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.053033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.053033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.053033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.053033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.053033] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.561518] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.054694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f in Status: SUCCESS [ 936.055106] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f deletion is rescheduled due to dependency. [ 936.055106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.065067] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.568536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.568694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.568767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.568989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.569099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.569199] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 936.601822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.601822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.601822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.601822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.602061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.611506] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 936.865684] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 936.866015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.866269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.866493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.866707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.866785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.866903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.866994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.867086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.867172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.867263] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.370756] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.371095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.371161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.371449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.371679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.371809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.371876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.372150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.372290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.372412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.372618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.372735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.372828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.373162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.373324] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.373428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.373492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.373644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.373724] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.373855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.373967] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.876612] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 937.897228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.897417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.897467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.897666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.897760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.897972] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.898169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.898246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.898411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.898510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.898797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.898914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.898992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.899157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.899233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.899553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.899668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.899725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.899869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.899942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.900071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 937.973956] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.974227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.974227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.974364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.974512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.994418] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 938.623104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 938.623438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.623539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.623947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.623947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.624163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.624163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.624261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.624345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.624427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.624523] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.127236] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.127446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.127685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.127857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.127958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.128512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.128602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.128662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.128796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.128930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.129081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.129159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.129300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.129375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.129452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.129539] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.283624] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 939.283784] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 939.298447] env[66919]: INFO networking_nsxv3.common.synchronization [req-59fff4e9-cf26-4d78-af59-77f6fbc92653 req-717019b4-21c0-43e4-8567-0f4d3a040ac2 tempest-ListImageFiltersTestJSON-425220867 tempest-ListImageFiltersTestJSON-425220867-project-member] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 939.299221] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 939.299376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.299530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.299586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.299758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.299909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.300049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.300106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.300216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.300438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.300438] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.327341] env[66919]: INFO networking_nsxv3.common.synchronization [req-cdbe03ba-2192-48f9-a15f-7c90aeffc50c req-abb88ce1-1bdb-4aa1-9e28-b112a3812a30 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 939.327792] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 939.328326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.328326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.328326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.328501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.329201] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.329201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.329201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.329201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.329201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.329201] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.631714] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 939.658552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.658694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.658694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.658955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.659031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.659254] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.659357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.659547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.660101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.660101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.660101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.660297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.660297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.660357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.661398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.661398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.661398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.661398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.661398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.661398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.661398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 939.802595] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.805892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.806256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.806256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.806659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.806659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.829034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 939.831830] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.020935] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 940.021399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.305415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.336085] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.807984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.808342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.808342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.808342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.808460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.808525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be updated. [ 940.837525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.837681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.837775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.837996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.838166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.839490] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.839648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.839717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.839921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.840077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.840291] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 940.855124] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 940.875455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.875616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.875692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.875913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.876185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.884772] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 941.844686] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 941.845115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.003840] env[66919]: INFO networking_nsxv3.common.synchronization [None req-83cd0f01-3793-4d5b-bc8f-31e3a191ef27 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 with Priority: HIGHEST for action security_group_rules [ 942.004454] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 with Priority: HIGHEST for action security_group_rules [ 942.004797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.004952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.005815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.006241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.006369] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26dda9e1-593c-4f6f-a2f9-de2d905a5aa3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.105923] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5df5da52-f0d1-4980-ac38-54cc193df0ad tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 with Priority: HIGHEST for action security_group_rules [ 942.108203] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 with Priority: HIGHEST for action security_group_rules [ 942.108571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.108676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.532673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.532791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.532995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.533343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.533492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.533755] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 already deleted. [ 942.533813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.534054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.534280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.534495] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('26dda9e1-593c-4f6f-a2f9-de2d905a5aa3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.865883] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 942.866281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.894793] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 942.895104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.056336] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.056530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.056530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.056702] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.057070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.057070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 26dda9e1-593c-4f6f-a2f9-de2d905a5aa3 already deleted. [ 943.057070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-26dda9e1-593c-4f6f-a2f9-de2d905a5aa3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.316157] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 944.316474] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 944.316905] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 944.317059] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 944.317300] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.317471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.317546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.317727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.318812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.319597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.319681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.320375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.320375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.320375] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.320892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.321013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.321143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.321250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.321489] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.321604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.321651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.321807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.321878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.322064] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_rules [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [req-1eb74904-dbef-4757-8d7d-d9d90791d092 req-f691885d-62f0-4a78-b185-489258e5b51a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_rules [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 944.375393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 944.375393] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.375393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.375393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.375393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.375393] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.376561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.376561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.376754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.376942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.377080] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.381751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ef3b82-13c1-4e9d-b057-215011c1ec9b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.381751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.381751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.381751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.381751] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ef3b82-13c1-4e9d-b057-215011c1ec9b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.381751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.381751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.381751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.381751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.826099] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.828401] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.882069] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.882069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.882413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.882670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.885055] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ef3b82-13c1-4e9d-b057-215011c1ec9b with status ACTIVE [ 944.885266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.885392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.885532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.885770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.885874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.886136] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.886316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.886436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.886578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.886672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.886865] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.886961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.887023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.887180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.887255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.887350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b is going to be updated. [ 944.919942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.920230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.920406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.920705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.920992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.921246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.329862] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.330699] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.786784] env[66919]: INFO networking_nsxv3.common.synchronization [req-d68006fc-e87a-43c6-b258-d04a87348bbc req-5c78840b-6972-479b-b43f-46ff8bac2247 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 945.786784] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 945.786923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.786992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.787081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.787245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.787582] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.787685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.787820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.787987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.788161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.788326] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.832750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.833034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.833034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.833160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.833252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.833353] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be created. [ 945.834671] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.834794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.834864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.835075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.835162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.835252] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 945.861693] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.861693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.861693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.862552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.862552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.864528] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.864678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.864737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.865102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.865102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.876108] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 945.878014] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: UNINITIALIZED for 2s [ 946.291980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.291980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.291980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.292248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.292248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.292405] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.292588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.292588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.292772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.292831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.292953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 946.330026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.330026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.330026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.330026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.330548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.343148] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 947.127200] env[66919]: INFO networking_nsxv3.common.synchronization [req-664080e8-739c-45c1-a835-3badf93fe0eb req-75298924-4fdf-454d-9ae7-36ffa4b86490 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 947.127200] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 947.132229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.135375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.135375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.135375] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.636403] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.636895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.636895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.636895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.636895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.637435] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.637553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.637553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.637705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.639057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.639057] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be updated. [ 947.670508] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.670697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.670759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.670925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.671211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.683026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 947.889145] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 947.890671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.890866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.891204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.891369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.891535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.891535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.891662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.891748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.891872] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.893406] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: SUCCESS [ 947.893545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.893686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.893851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.894016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.894123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.894186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.894322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.894399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.894485] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.354718] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 948.355676] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 948.355676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.396485] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.397254] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.899204] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.900221] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.402506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.403740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.403740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.403892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.403990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.404113] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 949.406216] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.406216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.406216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.406216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.406216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.406474] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be updated. [ 949.442119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.442291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.442355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.442616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.442833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.444947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.445103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.445151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.445309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.445442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.465296] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 949.466254] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: IN_PROGRESS for 2s [ 949.694050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 949.694050] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 deletion is rescheduled due to dependency. [ 949.694191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.860761] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 950.861060] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 950.861304] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 950.861852] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 950.861852] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 950.861997] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 950.862319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.862319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.862744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862744] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-816ab77f-aa4c-4c29-b9d4-04b40af94728 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.862916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.862916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.863177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.863496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.863496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.863496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.863674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.863769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.863848] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.920512] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 950.920799] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 950.920974] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_rules [ 950.921275] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 950.921482] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_rules [ 950.921677] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 950.921877] env[66919]: INFO networking_nsxv3.common.synchronization [req-7a7a4ffb-42e2-4f70-9ebb-b634cb7a0ef3 req-79ba8891-703b-446b-9d31-5b5c2b6715c7 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 950.922698] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_rules [ 950.922889] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_rules [ 950.923051] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 950.923196] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b with Priority: HIGHEST for action port [ 950.923349] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_rules [ 950.923844] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 950.924185] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 950.924932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.925141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.925383] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-816ab77f-aa4c-4c29-b9d4-04b40af94728 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.925517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.925635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.925975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.926106] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.927578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.927578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.927578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ef3b82-13c1-4e9d-b057-215011c1ec9b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.927732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.928354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.930081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.932669] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ef3b82-13c1-4e9d-b057-215011c1ec9b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.932669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.932669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.932669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.932669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.932669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-816ab77f-aa4c-4c29-b9d4-04b40af94728 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.932669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.366448] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.434737] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-816ab77f-aa4c-4c29-b9d4-04b40af94728 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.435191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.436323] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ef3b82-13c1-4e9d-b057-215011c1ec9b with status ACTIVE [ 951.436538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.436791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.436791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.437066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.437177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.437384] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.437514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.437691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.437691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.437826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.438043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.438202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.438202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.438618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.438618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.438618] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ef3b82-13c1-4e9d-b057-215011c1ec9b is going to be updated. [ 951.464100] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.464100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.464100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.464100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.464100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.464415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ef3b82-13c1-4e9d-b057-215011c1ec9b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.481415] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 951.481640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.482089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.482370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.482573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.482692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.482757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.483205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.483300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.483389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.483492] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.485633] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: SUCCESS [ 951.485835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.486029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.486220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.486399] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.486524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.486590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.486740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.486819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.486910] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.488425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.488425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.489167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.489345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.489458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.489670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.489759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.489848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.489943] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.492409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.492589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.492764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.492897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.492962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.493133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.493215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.493339] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.612527] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fd03993e-7fad-4754-a5c7-9ac589dd7dc8 None None] Enqueued Resource ID: f3a10234-ff47-4671-9605-b39dfc866349 with Priority: HIGHEST for action port [ 951.613152] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3a10234-ff47-4671-9605-b39dfc866349 with Priority: HIGHEST for action port [ 951.613434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3a10234-ff47-4671-9605-b39dfc866349 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.613847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3a10234-ff47-4671-9605-b39dfc866349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.613971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3a10234-ff47-4671-9605-b39dfc866349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.614282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3a10234-ff47-4671-9605-b39dfc866349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.614373] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3a10234-ff47-4671-9605-b39dfc866349',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.869411] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.993606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.993606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.993606] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.996981] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.997563] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.116162] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3a10234-ff47-4671-9605-b39dfc866349 [ 952.116384] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.116509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.116605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.116785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.116872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.116967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3a10234-ff47-4671-9605-b39dfc866349 already deleted. [ 952.117059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3a10234-ff47-4671-9605-b39dfc866349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.373148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.373325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.373397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.373628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.373715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.373972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 is going to be created. [ 952.399722] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.400509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.400509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.400840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.401015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.414324] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 in Status: UNINITIALIZED for 2s [ 952.442222] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e316c927-e56c-41bf-933c-8cd1740d0e0f tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 952.442481] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 952.442611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.442829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.442829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.444117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.444117] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.495534] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.502651] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.502909] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa0d2610-f032-4266-af7e-1e3cc1383f10: rpc.has_security_group_logging(os_id): False [ 952.523102] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.523289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.523367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.523594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.523939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.523939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.524086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.524086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.524349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.524403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.524481] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be created. [ 952.544195] env[66919]: INFO networking_nsxv3.common.synchronization [None req-36da7abf-57f7-48b5-a11b-cde179361dfd tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 952.544740] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 952.545135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.545253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.583776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.583919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.583919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.584158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.584342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.599536] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: IN_PROGRESS for 2s [ 952.966363] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.966363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.966875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.966875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.966875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.966875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da753667-590d-44b7-b73e-76baaab11b84 already deleted. [ 952.966875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.967513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.968410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.968410] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.001123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.001318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.002445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.002445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.002445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.002445] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 953.005312] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.005557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.005690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.005941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.006059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.006184] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be updated. [ 953.068919] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.068919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.068919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.068919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.068919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.070925] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.071092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.071154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.071311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.071444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.084230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: IN_PROGRESS for 2s [ 953.084230] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 953.498885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.499747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.499747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.499747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.499747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.499747] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da753667-590d-44b7-b73e-76baaab11b84 already deleted. [ 953.499747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.799141] env[66919]: INFO networking_nsxv3.common.synchronization [req-258e7c5e-04d3-48ec-aa50-ba12365ff9e8 req-22f292c0-e426-41ec-9ab8-dd774245b1e2 tempest-ServerGroupTestJSON-1369218435 tempest-ServerGroupTestJSON-1369218435-project-member] Enqueued Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 953.799785] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 953.800130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.800249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.800315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.800563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.800720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.800819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.800982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.801079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.801559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.801559] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.133260] env[66919]: INFO networking_nsxv3.common.synchronization [req-d545578c-7fde-4006-a749-14ce933fa1d2 req-13276ea6-e5bc-47ad-8ccd-3af6de95c7f1 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 954.133584] env[66919]: INFO networking_nsxv3.common.synchronization [req-d545578c-7fde-4006-a749-14ce933fa1d2 req-13276ea6-e5bc-47ad-8ccd-3af6de95c7f1 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 954.133646] env[66919]: INFO networking_nsxv3.common.synchronization [req-d545578c-7fde-4006-a749-14ce933fa1d2 req-13276ea6-e5bc-47ad-8ccd-3af6de95c7f1 tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 954.134490] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 with Priority: HIGHEST for action security_group_members [ 954.134854] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 with Priority: HIGHEST for action security_group_members [ 954.134854] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 954.135140] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa0d2610-f032-4266-af7e-1e3cc1383f10 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.135392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-816ab77f-aa4c-4c29-b9d4-04b40af94728 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.135477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.136492] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.136592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.198207] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-390 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.198513] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-390" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.198722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-390" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.199289] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-390" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.199631] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.202021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.202021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.202021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.202021] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.202021] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.202021] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.202021] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.202021] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.202021] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.202021] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.202021] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.225332] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.226088] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.226088] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.226324] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-390" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.226835] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-b7929230-b295-4f5d-ab60-0e076d33a39f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.227310] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.227390] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.228010] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.231232] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7929230-b295-4f5d-ab60-0e076d33a39f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.236381] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5c196154-45c4-4bf4-bd68-38825bb13943 None None] Enqueued Resource ID: ccca16bd-d278-43e5-b3fc-7638576d077d with Priority: HIGHEST for action port [ 954.237777] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ccca16bd-d278-43e5-b3fc-7638576d077d with Priority: HIGHEST for action port [ 954.238240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ccca16bd-d278-43e5-b3fc-7638576d077d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.238401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ccca16bd-d278-43e5-b3fc-7638576d077d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.238502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ccca16bd-d278-43e5-b3fc-7638576d077d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.239075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ccca16bd-d278-43e5-b3fc-7638576d077d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.239254] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ccca16bd-d278-43e5-b3fc-7638576d077d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.306979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.306979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.306979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.306979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.306979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.307353] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.307353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.307353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.307537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.307537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.307640] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 already deleted. [ 954.308609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.428280] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 in Status: SUCCESS [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.428280] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.428280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.428280] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.701812] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: SUCCESS [ 954.701812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.701812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.701812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.701812] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.738433] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.738741] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.738797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.739050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.739285] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.739340] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port b7929230-b295-4f5d-ab60-0e076d33a39f not found, creating... [ 954.739601] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.739761] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.739877] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.740114] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.741509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.741509] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.741509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.741509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.741509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.741509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.741509] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: b7929230-b295-4f5d-ab60-0e076d33a39f is going to be created. [ 954.742358] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ccca16bd-d278-43e5-b3fc-7638576d077d [ 954.742626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.742626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.742626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.742902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.742940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.743050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ccca16bd-d278-43e5-b3fc-7638576d077d already deleted. [ 954.743183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ccca16bd-d278-43e5-b3fc-7638576d077d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.766164] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.766164] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.766164] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.766164] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.766797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.766797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.931470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.931830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.931830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.931975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.932118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.932360] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.932488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.932550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.932759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.932867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.932999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 is going to be deleted. [ 954.967041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.967232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.967232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.967404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.967500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.967600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.967792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.967965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.968153] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.968253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.968314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.968457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.968533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.968623] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.096136] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 955.096410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.096527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.096818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.097020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.097247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.097247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.097465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.097550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.097606] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.099494] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 in Status: SUCCESS [ 955.099494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.099590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.099706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.099874] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.100024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.100065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.100181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.100256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.100348] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.144569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.144569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.144569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.144569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.144569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.144569] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be deleted. [ 955.193840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.193991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.194073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.194291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.194382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.194491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.450541] env[66919]: INFO networking_nsxv3.common.synchronization [req-87399763-baba-4883-ab9d-4e3778ec1d99 req-a76746bc-413d-45de-88ba-8c945b8dbca6 tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 955.451106] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 955.451450] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.451553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.451620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.451812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.451960] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.452522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.452522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.452522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.452522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.452522] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.471092] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.472514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.472514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.472514] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 already deleted. [ 955.472514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.472676] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.474734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.474734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.474734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.474734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.474734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.475513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.475513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.475513] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.527448] env[66919]: INFO networking_nsxv3.common.synchronization [req-258e7c5e-04d3-48ec-aa50-ba12365ff9e8 req-bec29f18-5dc2-4635-b932-721a5b2dfc96 service nova] Enqueued Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_rules [ 955.527448] env[66919]: INFO networking_nsxv3.common.synchronization [req-258e7c5e-04d3-48ec-aa50-ba12365ff9e8 req-bec29f18-5dc2-4635-b932-721a5b2dfc96 service nova] Enqueued Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 955.527448] env[66919]: INFO networking_nsxv3.common.synchronization [req-258e7c5e-04d3-48ec-aa50-ba12365ff9e8 req-bec29f18-5dc2-4635-b932-721a5b2dfc96 service nova] Enqueued Resource ID: b7929230-b295-4f5d-ab60-0e076d33a39f with Priority: HIGHEST for action port [ 955.527698] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_rules [ 955.527741] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 955.527821] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7929230-b295-4f5d-ab60-0e076d33a39f with Priority: HIGHEST for action port [ 955.528517] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.528635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.528703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.528964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.529063] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.530375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.530375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.530375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.530375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.530375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.531450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.531450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.531450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.531576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.531609] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.533085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7929230-b295-4f5d-ab60-0e076d33a39f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.533085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.533085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.533085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.533085] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7929230-b295-4f5d-ab60-0e076d33a39f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.602784] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.603405] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.603562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.603641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.603850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.603955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.604152] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.604294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.604367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.604542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.604631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.604721] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 is going to be deleted. [ 955.633517] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.633667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.633734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.633991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.634185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.634287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.634469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.634633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.634850] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.634966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.635037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.635196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.635272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.635373] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa0d2610-f032-4266-af7e-1e3cc1383f10',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.785078] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-173 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.785371] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.785504] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.785797] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.788379] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.788379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.788379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.788901] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.788901] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.789094] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.789214] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.789464] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.789464] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.789558] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.789692] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.789826] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.811145] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.811340] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.811477] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.811647] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-173" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.811960] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-e641e3e2-7cb6-41ff-bccf-575204d3ee46 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.812149] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.812265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.812577] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.812716] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e641e3e2-7cb6-41ff-bccf-575204d3ee46',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.954765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.955232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.955232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.955505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.955668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.955985] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.956190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.956306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.956517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.956642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.956770] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 955.974500] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('816ab77f-aa4c-4c29-b9d4-04b40af94728',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.977376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.977599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.977676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.977914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.978127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.978365] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.978423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.978454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.979308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.979308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.979308] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 already deleted. [ 955.979308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.986512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.986671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.986727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.986927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.987083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.998397] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 956.034639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.034639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.034981] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.036051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7929230-b295-4f5d-ab60-0e076d33a39f with status ACTIVE [ 956.038019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.038019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.038019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.038019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.038019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.038019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.038480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.038480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.038480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.038570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.038738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.038824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.038860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.039022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.039097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.039177] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7929230-b295-4f5d-ab60-0e076d33a39f is going to be updated. [ 956.060962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.063200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.064006] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.064006] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.064006] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.064006] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7929230-b295-4f5d-ab60-0e076d33a39f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.107451] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.139877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.140069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.140136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.140344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.140424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.140621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.140726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.140791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.140944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.141031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.141121] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa0d2610-f032-4266-af7e-1e3cc1383f10 already deleted. [ 956.141319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa0d2610-f032-4266-af7e-1e3cc1383f10" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.316053] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.316407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.316451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.316747] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.316896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.317120] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port e641e3e2-7cb6-41ff-bccf-575204d3ee46 not found, creating... [ 956.317360] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.317525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.317628] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.317895] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.318009] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.318341] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.318462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.318584] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.318793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.318931] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.319109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: e641e3e2-7cb6-41ff-bccf-575204d3ee46 is going to be created. [ 956.346973] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.347678] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.347678] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.347793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.348220] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.348380] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.476908] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 816ab77f-aa4c-4c29-b9d4-04b40af94728: rpc.has_security_group_logging(os_id): False [ 956.499386] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.499547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.499621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.499836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.499929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.500167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.500268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.500332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.500507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.500583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.500669] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 is going to be created. [ 956.519222] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728], does not exist path=[/infra/domains/default/groups/816ab77f-aa4c-4c29-b9d4-04b40af94728]."\n}' [ 956.519402] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728 [ 956.519488] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 956.541453] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.567999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.568236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.568299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.568470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.569966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.570182] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.570312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.570351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.570531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.570625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.570804] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.570895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.570968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.571109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.571180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.571266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 816ab77f-aa4c-4c29-b9d4-04b40af94728 is going to be created. [ 956.593760] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728], does not exist path=[/infra/domains/default/groups/816ab77f-aa4c-4c29-b9d4-04b40af94728]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728 [ 956.593760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-816ab77f-aa4c-4c29-b9d4-04b40af94728" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.593760] env[66919]: Traceback (most recent call last): [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 956.593760] env[66919]: return func(*args, **kwargs) [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.593760] env[66919]: res.raise_for_status() [ 956.593760] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 956.593760] env[66919]: raise HTTPError(http_error_msg, response=self) [ 956.593760] env[66919]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728 [ 956.593760] env[66919]: During handling of the above exception, another exception occurred: [ 956.593760] env[66919]: Traceback (most recent call last): [ 956.593760] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 956.593760] env[66919]: listener.cb(fileno) [ 956.593760] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 956.593760] env[66919]: result = function(*args, **kwargs) [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 956.593760] env[66919]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 956.593760] env[66919]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 956.593760] env[66919]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 956.593760] env[66919]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.593760] env[66919]: res.raise_for_status() [ 956.593760] env[66919]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 956.593760] env[66919]: raise HTTPError(http_error_msg, response=self) [ 956.593760] env[66919]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/816ab77f-aa4c-4c29-b9d4-04b40af94728 [ 956.593760] env[66919]: Removing descriptor: 24 [ 956.610649] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.610649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.610649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.610906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.610906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.610983] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 956.653637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.653874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.653971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.655059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.655059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.664998] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 957.036979] env[66919]: INFO networking_nsxv3.common.synchronization [req-87399763-baba-4883-ab9d-4e3778ec1d99 req-82e30fa7-40a6-4f48-96de-f07c1faaf971 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 957.037256] env[66919]: INFO networking_nsxv3.common.synchronization [req-87399763-baba-4883-ab9d-4e3778ec1d99 req-82e30fa7-40a6-4f48-96de-f07c1faaf971 service nova] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 957.037368] env[66919]: INFO networking_nsxv3.common.synchronization [req-87399763-baba-4883-ab9d-4e3778ec1d99 req-82e30fa7-40a6-4f48-96de-f07c1faaf971 service nova] Enqueued Resource ID: e641e3e2-7cb6-41ff-bccf-575204d3ee46 with Priority: HIGHEST for action port [ 957.037907] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_rules [ 957.038625] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 957.038923] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e641e3e2-7cb6-41ff-bccf-575204d3ee46 with Priority: HIGHEST for action port [ 957.039131] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.039367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.039470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.039687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.039827] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.042019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.042990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.043201] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e641e3e2-7cb6-41ff-bccf-575204d3ee46 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.043386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.043443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.043654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.043739] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e641e3e2-7cb6-41ff-bccf-575204d3ee46',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.044967] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.045126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.045249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.045454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.045568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.045683] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 is going to be created. [ 957.070963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.071199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.071199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.071421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.071553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.083890] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: UNINITIALIZED for 2s [ 957.543074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.543424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.549102] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e641e3e2-7cb6-41ff-bccf-575204d3ee46 with status ACTIVE [ 957.549102] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.549102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.549102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.549102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.549102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.549383] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.549383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.549383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.549550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.549613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.549792] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.549886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.549939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.550152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.550201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.550242] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e641e3e2-7cb6-41ff-bccf-575204d3ee46 is going to be updated. [ 957.576518] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.576824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.576824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.577535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.577535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.577535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e641e3e2-7cb6-41ff-bccf-575204d3ee46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.004552] env[66919]: INFO networking_nsxv3.common.synchronization [req-20157817-5e4f-4e6f-8331-967a4fabf96f req-6fe94601-16ef-4de0-ae91-92f7ac90ef5b tempest-DeleteServersAdminTestJSON-765803948 tempest-DeleteServersAdminTestJSON-765803948-project-member] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 958.005219] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 958.005548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.005675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.005747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.005988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.006166] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.006271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.006330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.006488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.006574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.006668] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.018682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 958.018906] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc deletion is rescheduled due to dependency. [ 958.019392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.021164] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.021164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.021164] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.325878] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cfa3801-d6c3-42cd-bcfe-1f432904a091 req-25751986-7b10-4d4b-9fd4-71ad7da31ad9 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 958.326462] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 958.326934] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.326934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.327114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.327412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.327600] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.327745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.327812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.328666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.328802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.328924] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.460211] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.460450] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.460587] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.460873] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.461182] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.461372] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.461492] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.461746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.461906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.462132] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.462246] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.462351] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.462457] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.462593] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.462720] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.462870] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.484054] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.484247] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.484382] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.484551] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-123" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.484952] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.485153] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.485267] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.485718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.485807] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f6fda5-ae7e-4c49-849e-96c0c6e193e1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.509734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.509883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.509922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.510211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.525246] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.532846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.533117] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.533239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.533308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.533542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.533625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.533718] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be updated. [ 958.564506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.564935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.564935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.565028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.565266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.575976] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 958.674205] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 958.674440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.675077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.675297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.675621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.675621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.675816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.675816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.677531] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.678100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.678968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.678968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.678968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.678968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.678968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.678968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.678968] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.767750] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.767955] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.768092] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.768372] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.768631] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.768787] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.768902] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.769126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.769272] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.769476] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.769612] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.769738] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.769849] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.769962] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 958.770080] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.770213] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.789993] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.790162] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 958.790269] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.790520] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.790880] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.791126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.791307] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.791700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.791873] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec7f752-4f86-4c58-9f7d-aff04f7a9a84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.831764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.831764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.831764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.832038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.853577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.853839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.853962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.854046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.854269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.854355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.854449] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 958.879130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.879335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.879335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.879551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.879690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.888920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 958.988145] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.988488] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.988662] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.989059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.989267] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.989471] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 not found, creating... [ 958.989844] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.990040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.990242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.990526] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.990695] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.991089] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.991288] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.991452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.991733] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.991885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.992051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 is going to be created. [ 959.012228] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.012474] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.012607] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.012941] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.013203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.013438] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.027271] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.098401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: SUCCESS [ 959.098672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.099351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.099676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.099915] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.100128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.100219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.100408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.100537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.100650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.100700] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.181159] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 959.182436] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.202241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.202241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.202241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.202542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.223430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.223693] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.223815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.223883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.224116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.224238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.224397] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.224495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.224558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.224765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.224853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.225069] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.225188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.225238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.225374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.225449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.225535] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 959.295105] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.295292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.295434] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.295759] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.295911] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.296100] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 not found, creating... [ 959.296398] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.296563] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.296689] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.296933] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.297093] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.297401] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.297569] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.297700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.297951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.298067] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.298228] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 is going to be created. [ 959.320401] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.320641] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.320722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.321151] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.321332] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.321554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.341507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.341666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.341758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.341991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.342154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.363931] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 959.530291] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.530500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.530587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.530811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.530909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.531049] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 959.569009] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.569314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.569314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.569509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.569694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.579053] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 959.603732] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.603975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.604030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.604255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.604479] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.604548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.604583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.604775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.604869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.604962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.605138] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.605236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.605301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.605455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.605594] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.605722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.605819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.605955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.606031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.606120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.606241] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.685559] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.786176] env[66919]: INFO networking_nsxv3.common.synchronization [req-20157817-5e4f-4e6f-8331-967a4fabf96f req-9728e301-3bb7-471b-9490-cfb8da7496e0 service nova] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_rules [ 959.786364] env[66919]: INFO networking_nsxv3.common.synchronization [req-20157817-5e4f-4e6f-8331-967a4fabf96f req-9728e301-3bb7-471b-9490-cfb8da7496e0 service nova] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 959.786523] env[66919]: INFO networking_nsxv3.common.synchronization [req-20157817-5e4f-4e6f-8331-967a4fabf96f req-9728e301-3bb7-471b-9490-cfb8da7496e0 service nova] Enqueued Resource ID: 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 with Priority: HIGHEST for action port [ 959.787185] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_rules [ 959.787340] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 959.787439] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 with Priority: HIGHEST for action port [ 959.787733] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.787902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.787972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.788179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.788261] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.790061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.790061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.790061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.790061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.790061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.790404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.790404] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83f6fda5-ae7e-4c49-849e-96c0c6e193e1',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.076265] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cfa3801-d6c3-42cd-bcfe-1f432904a091 req-9d735519-3d5d-4e37-a9ee-cf468ab230e0 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 960.076265] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cfa3801-d6c3-42cd-bcfe-1f432904a091 req-9d735519-3d5d-4e37-a9ee-cf468ab230e0 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 960.076265] env[66919]: INFO networking_nsxv3.common.synchronization [req-8cfa3801-d6c3-42cd-bcfe-1f432904a091 req-9d735519-3d5d-4e37-a9ee-cf468ab230e0 service nova] Enqueued Resource ID: 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 with Priority: HIGHEST for action port [ 960.077129] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 960.077389] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 960.077608] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 with Priority: HIGHEST for action port [ 960.078170] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.080790] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.080790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.080790] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.080790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.081149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.081149] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ec7f752-4f86-4c58-9f7d-aff04f7a9a84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.111709] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55d7cafa-a304-4afc-9136-b32b28d8fdc3: rpc.has_security_group_logging(os_id): False [ 960.130856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.130856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.130856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.130856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.131474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.131474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.131474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.131474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.131474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.131474] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 is going to be created. [ 960.188604] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.188796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.188875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.189144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.189256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.189369] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 960.195180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.195314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.195380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.195580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.195805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.210732] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: IN_PROGRESS for 2s [ 960.225849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.226128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.226244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.226567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.226803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.251722] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 960.293741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.293866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.294116] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 with status ACTIVE [ 960.294292] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.294400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.294463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.294768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.294805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.295153] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.295153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.295153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.295297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.295338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.295518] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.295608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.295678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.295890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.295970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.296069] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83f6fda5-ae7e-4c49-849e-96c0c6e193e1 is going to be updated. [ 960.340201] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.340201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.340201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.340439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.340545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.340757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83f6fda5-ae7e-4c49-849e-96c0c6e193e1" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.582807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.583159] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 with status ACTIVE [ 960.583881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.583881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.583881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.583881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.583881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.583881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.585259] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.585259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.585259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ec7f752-4f86-4c58-9f7d-aff04f7a9a84 is going to be updated. [ 960.587104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 960.587282] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 deletion is rescheduled due to dependency. [ 960.587394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.587533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.587702] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.587861] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.587977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.588032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.588182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.588270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.588353] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.608656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.608863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.608863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.609074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.609217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.609379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ec7f752-4f86-4c58-9f7d-aff04f7a9a84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.899712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 960.899927] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 deletion is rescheduled due to dependency. [ 960.900104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.900275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.900661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.900661] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.900799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.900835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.901150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.901150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.901224] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.090700] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.391888] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 961.392768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.392768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.392768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.393132] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.404732] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.591064] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 961.591064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.591064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.591375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.591417] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.591576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.591576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.591723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.591807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.592311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.592311] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.593966] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.690760] env[66919]: INFO networking_nsxv3.common.synchronization [req-bd8ab886-c2a9-44ec-8fac-0b05da93b8f0 req-d016d460-5bb3-48eb-ae3d-f389b0e0f714 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 961.691848] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 961.692335] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.692524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.692947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.692947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.694381] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.694381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.694381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.694381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.694381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.694381] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.896023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.896636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.908175] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.097989] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.098177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.098223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.098534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.098761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.098877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.098945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.099144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.099234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.099326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.099514] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.099580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.099631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.099778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.099920] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.100016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.100237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.100518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.100679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.100825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.100940] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.101964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.102123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.102222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.102384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.102468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.102590] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be updated. [ 962.133427] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.133646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.133748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.134098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.134384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.147154] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 962.155904] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.156143] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.156315] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.158336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.158336] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.158336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.158336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.158336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.158336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.158336] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.158336] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.158943] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.158943] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.158943] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.158943] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.158943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.179687] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.180069] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.180280] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.180605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.181170] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-a0f5a959-af73-4aca-a792-9848a3176587 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.181458] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.181663] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.182116] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.182333] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f5a959-af73-4aca-a792-9848a3176587',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.199630] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.199630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.199630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.199630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.223855] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: SUCCESS [ 962.223855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.224736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.224968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.225095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.225158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.225353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.225429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.225511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 962.268469] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 962.268469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.270389] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.270389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.270389] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.272689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.272689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.272689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.272891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.273017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.290097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 962.410984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.411166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.411234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.411553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.411674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.411775] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 962.450761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.450967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.451059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.451327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.451477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.466826] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 962.604509] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c38fec75-1824-4123-9a27-d70b3e15c2bc: rpc.has_security_group_logging(os_id): False [ 962.625694] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.625898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.625950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.626221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.652697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.653111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.653303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.653406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.653646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.653750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.653958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.654094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.654163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.654341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.654420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.654601] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.654717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.654783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.654925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.655010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.655100] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 962.688955] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.689243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.689376] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.689687] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.689853] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.690027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port a0f5a959-af73-4aca-a792-9848a3176587 not found, creating... [ 962.690315] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.690474] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.690590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.690829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.690968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.691275] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.691432] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.691559] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.691775] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.691922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.692076] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: a0f5a959-af73-4aca-a792-9848a3176587 is going to be created. [ 962.713998] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.714161] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.714300] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.714770] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.714930] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.715183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.732707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.732969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.732969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.733258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.733408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.749092] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 962.775156] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.775385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.775474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.775695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.775945] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.776079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.776144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.776338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.776397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.776467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.776682] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.776787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.776846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.776995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.777162] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.777370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.777370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.777484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.777550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.777634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.777733] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.279742] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b279846-5f96-463a-ab8f-df707aa1a846: rpc.has_security_group_logging(os_id): False [ 963.326973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.327311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.327311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.327500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.327602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.327886] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.327955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.328041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.328173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.328252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.328448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.328542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.328607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.328811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.328910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.329379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.329379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.329379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.329578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.329578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.329578] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 963.410735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.411315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.411315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.411658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.411833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.437529] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 963.484787] env[66919]: INFO networking_nsxv3.common.synchronization [req-bd8ab886-c2a9-44ec-8fac-0b05da93b8f0 req-5561de64-ae36-4afe-9c89-bb724924890c service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 963.485020] env[66919]: INFO networking_nsxv3.common.synchronization [req-bd8ab886-c2a9-44ec-8fac-0b05da93b8f0 req-5561de64-ae36-4afe-9c89-bb724924890c service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 963.485174] env[66919]: INFO networking_nsxv3.common.synchronization [req-bd8ab886-c2a9-44ec-8fac-0b05da93b8f0 req-5561de64-ae36-4afe-9c89-bb724924890c service nova] Enqueued Resource ID: a0f5a959-af73-4aca-a792-9848a3176587 with Priority: HIGHEST for action port [ 963.485830] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 963.486058] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 963.486219] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0f5a959-af73-4aca-a792-9848a3176587 with Priority: HIGHEST for action port [ 963.486656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.486815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.486978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.487186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.487277] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.488329] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.488460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.489340] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0f5a959-af73-4aca-a792-9848a3176587 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.489497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.489572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.490228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.490228] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0f5a959-af73-4aca-a792-9848a3176587',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.853424] env[66919]: INFO networking_nsxv3.common.synchronization [req-aeebbf28-43f0-4d94-92ff-ead0f8b53980 req-d8d1cd37-a884-40d0-8fb8-aa736f0df7f2 tempest-ListImageFiltersTestJSON-425220867 tempest-ListImageFiltersTestJSON-425220867-project-member] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 963.854012] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGHEST for action security_group_members [ 963.855052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.855417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.855417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.855666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.855857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.855966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.856064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.856225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.856308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.856404] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.993086] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.993270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.994669] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0f5a959-af73-4aca-a792-9848a3176587 with status ACTIVE [ 963.994908] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.995092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.995168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.995557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.995557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.995681] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.995801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.995855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.996020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.996110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.996294] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.996395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.996468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.996583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.996659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.996739] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0f5a959-af73-4aca-a792-9848a3176587 is going to be updated. [ 964.019572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.019768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.019768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.019988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.020183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.020355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0f5a959-af73-4aca-a792-9848a3176587" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.158598] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 964.158942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.159165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.159359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.159547] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.159661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.159789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.159886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.159979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.160217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.160217] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.316048] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 964.316048] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 964.316048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.316048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.316048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.316048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.316048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.316048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.316651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.316767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.316883] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.358860] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.359544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.359775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.360053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.390483] env[66919]: INFO networking_nsxv3.common.synchronization [req-ff80545f-013b-4fd3-9960-2835a7160f29 req-bfa191bc-0d69-4fd5-acb6-569703a42ef0 tempest-ServersAdminTestJSON-420189949 tempest-ServersAdminTestJSON-420189949-project-member] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 964.392379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.392816] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.393043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.393156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.393483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.393626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.393816] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be updated. [ 964.396787] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGHEST for action security_group_members [ 964.397930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.398171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.398278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.398605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.398921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.399066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.399171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.399442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.399589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.399775] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.433018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.433560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.433560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.433706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.433814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.445103] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: IN_PROGRESS for 2s [ 964.656184] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 964.656184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.656445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.656831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.656831] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.656926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.656976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.657130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.657210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.657291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.657379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.662862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.663050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.663094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.663292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.663463] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.663553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.663651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.663860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.663985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.664057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.664182] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.664274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.664334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.664467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.664673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.665212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.665212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.665212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.665212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.665212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.665212] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.767465] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 964.767850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.820093] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.903521] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.903998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.903998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.904187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.930476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.930845] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.930993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.931065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.931328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.931469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.931582] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be updated. [ 964.971413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.971581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.971639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.971891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.972058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.985560] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: IN_PROGRESS for 2s [ 965.159929] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.159929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.159929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.159929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.160320] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.160320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.160320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.160586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.160586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.160586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.160712] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.160804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.160859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.160993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.161146] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.161235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.161277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.161408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.161480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.161555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.161674] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.167265] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5116cc0e-6bd6-420e-8fb5-142b35508ce3: rpc.has_security_group_logging(os_id): False [ 965.185381] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.185541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.185608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.185930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.186051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.186264] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.186361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.186429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.186573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.186650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.186855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.186946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.187023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.187167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.187254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.187462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.187558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.187619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.187759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.187831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.187936] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be updated. [ 965.279051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.279051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.279051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.279369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.279403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.312394] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 965.322874] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.464516] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 965.465149] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.664475] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8993b03-159d-4cb8-a490-873c724e7d28: rpc.has_security_group_logging(os_id): False [ 965.687434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.687578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.687661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.687867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.687967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.688452] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.688452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.688452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.688804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.688804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.688804] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.688940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.688977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.689118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.689189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.689364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.689461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.689534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.689759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.689759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.689867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 965.779519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.779744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.779835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.780078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.780275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.812682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 965.825445] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.825802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.825903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.826169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.826291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.826411] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 965.879328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.879514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.879616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.879878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.880073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.890052] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 966.456121] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d in Status: SUCCESS [ 966.456121] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d deletion is rescheduled due to dependency. [ 966.456121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.996699] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb in Status: SUCCESS [ 966.997125] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb deletion is rescheduled due to dependency. [ 966.997125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.325866] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 967.326121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.530048] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a238e262-9aa2-4ecd-95f4-42a5cb8c2133 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 967.534065] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 967.534423] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.534549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.534630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.534857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.535029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.535312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.535373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.535522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.535620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.535716] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.827080] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 967.827988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.900723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 967.900945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.901145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.901357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.901548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.901651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.902327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.902327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.902327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.902327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.902327] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.039079] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.404636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.404928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.405205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.405728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.407036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.407036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.407036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.407036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.407036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.407036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.407434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.408061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.408061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.408061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.408325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.408325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.408403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.408661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.408790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.408952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.409148] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.541950] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.778660] env[66919]: INFO networking_nsxv3.common.synchronization [None req-bcc75bf5-d9b2-46f5-ad56-95d0019e23b8 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 968.780026] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 968.780616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.780809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.780932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.781665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.781665] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.802713] env[66919]: INFO networking_nsxv3.common.synchronization [req-1bb36b62-4669-4432-bb0b-821a671f4c2c req-f8b0f9df-8a21-4fd1-96bd-2a7dd710b5b2 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 968.803929] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 968.804267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.804435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.804592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.804911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.805150] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.805319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.805527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.805861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.806013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.806434] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.912502] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 968.935680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.935897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.935988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.936284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.936399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.936635] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.936753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.936825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.937037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.937177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.937362] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.937471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.937573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.937732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.937821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.940168] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.940309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.940378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.940575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.940689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.940751] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 968.980710] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c8d39018-c811-4d5b-85c6-9f2ffe21ead5 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 968.981287] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 968.981641] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.981771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.028806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.028908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.029220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.029424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.044263] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 969.045017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.045017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.045875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.045875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.045875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.045875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 969.096105] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.096105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.096105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.096105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.096105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.116830] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 969.234261] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.234457] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.234612] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.235384] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.235682] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.235841] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.235956] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.236197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.236346] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.236559] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.236665] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.236775] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.236907] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.237047] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.237157] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.237293] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.275529] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.275834] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.275984] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.276264] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.276596] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-7c09cce3-1a99-4793-aae4-d575721e8487 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.276913] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.277076] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.277552] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.277975] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c09cce3-1a99-4793-aae4-d575721e8487',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.305628] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.305880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.305980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.306280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.306387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.306515] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 already deleted. [ 969.306635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.307156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.307400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.307526] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.310114] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.780721] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.781126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.781126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.781758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.781758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.781758] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 7c09cce3-1a99-4793-aae4-d575721e8487 not found, creating... [ 969.781922] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.782080] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.782169] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.782393] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.782708] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.782842] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.783022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.783234] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.783554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.783762] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.783921] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 7c09cce3-1a99-4793-aae4-d575721e8487 is going to be created. [ 969.805380] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.805636] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.805748] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.806049] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.806291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.806520] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.812484] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.828650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.828929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.828929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.829192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.829283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.829382] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 already deleted. [ 969.829508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.901286] env[66919]: INFO networking_nsxv3.common.synchronization [req-c907617e-e08c-4a42-b123-9b537cb13b50 req-97858383-233a-4836-9dc3-9fea0ad8665f tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 969.901891] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 969.902401] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.902401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.902619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.902762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.902931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.903097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.903158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.903387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.903480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.903576] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.315373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.315373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.315727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.315767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.315905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.316110] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 970.348022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.348247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.348306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.348597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.348954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.370803] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 970.406613] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.406856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.406856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.407213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.433821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.434154] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.434316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.434388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.434670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.434761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.434853] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 970.472635] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.472635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.472812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.472974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.473073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.482593] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 970.586293] env[66919]: INFO networking_nsxv3.common.synchronization [req-1bb36b62-4669-4432-bb0b-821a671f4c2c req-babae926-3827-4c31-91aa-5060b12fea11 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 970.586380] env[66919]: INFO networking_nsxv3.common.synchronization [req-1bb36b62-4669-4432-bb0b-821a671f4c2c req-babae926-3827-4c31-91aa-5060b12fea11 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 970.586531] env[66919]: INFO networking_nsxv3.common.synchronization [req-1bb36b62-4669-4432-bb0b-821a671f4c2c req-babae926-3827-4c31-91aa-5060b12fea11 service nova] Enqueued Resource ID: 7c09cce3-1a99-4793-aae4-d575721e8487 with Priority: HIGHEST for action port [ 970.587290] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 970.587336] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 970.587431] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c09cce3-1a99-4793-aae4-d575721e8487 with Priority: HIGHEST for action port [ 970.588158] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.588251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.588321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.588556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.588642] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.589603] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.589706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.589905] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c09cce3-1a99-4793-aae4-d575721e8487 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.590014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.590082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.590277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.590354] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c09cce3-1a99-4793-aae4-d575721e8487',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.063906] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 971.064198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.091840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.091974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.093368] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c09cce3-1a99-4793-aae4-d575721e8487 with status ACTIVE [ 971.093568] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.093687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.093781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.093965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.094063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.094243] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.094357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.094402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.094564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.094955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.095363] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.095583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.095683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.095873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.096790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.096790] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c09cce3-1a99-4793-aae4-d575721e8487 is going to be updated. [ 971.122976] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.123227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.123227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.123391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.123626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.123790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c09cce3-1a99-4793-aae4-d575721e8487" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.129070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 971.129284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.539762] env[66919]: INFO networking_nsxv3.common.synchronization [req-f8eefbf0-9ddf-44d4-b8c9-c7aef380fea5 req-4da07a5b-cef0-483b-99a2-555dfea91106 tempest-ServerGroupTestJSON-1369218435 tempest-ServerGroupTestJSON-1369218435-project-member] Enqueued Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 971.540393] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGHEST for action security_group_members [ 971.541223] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.541368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.542048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.542048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.542048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.542048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.542048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.542264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.542264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.542264] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.854762] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.854983] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.855140] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.855413] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.855683] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.855874] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.856020] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.856249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.856400] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.856598] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.856706] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.856836] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.856907] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.857018] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.857121] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.857250] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.880308] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.880308] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.880471] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.880951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.880951] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.881153] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.881554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.881779] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.882190] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea104c4f-74f8-45ab-a6f1-12a40ef3ab33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.045215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.045215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.045215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.045215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.045215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.046303] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.046374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.046461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.046681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.046782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.046897] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 is going to be updated. [ 972.077989] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.078355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.078355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.078421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.079496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.093742] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: IN_PROGRESS for 2s [ 972.191249] env[66919]: INFO networking_nsxv3.common.synchronization [req-dca1fa44-ddc7-4510-9875-4ae5367cc08e req-4e143dcd-bb18-43ab-b0af-e63e5e1bb86c tempest-ImagesOneServerNegativeTestJSON-547972406 tempest-ImagesOneServerNegativeTestJSON-547972406-project-member] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 972.191853] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGHEST for action security_group_members [ 972.192192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.192330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.192403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.192772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.192949] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.193074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.193142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.193311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.193397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.193494] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.381716] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 972.382086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.382349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.382682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.382939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.383073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.383135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.383317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.383402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.383522] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.384977] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.385184] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.385313] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.385647] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.385800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.386677] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 not found, creating... [ 972.386677] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.387073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.387073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.387073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.387183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.387478] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.387634] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.387746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.387951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.388126] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.388275] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 is going to be created. [ 972.412782] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.413512] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.413512] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.413659] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.414076] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.414381] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.493760] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 972.493944] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 972.494018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.695441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.695691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.695791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.695996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.696104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.696321] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.696441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.696507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.696647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.696722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.696874] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be updated. [ 972.733671] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.734572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.734572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.734572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.734795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.744484] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: IN_PROGRESS for 2s [ 972.890524] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.169171] env[66919]: INFO networking_nsxv3.common.synchronization [req-e7c27b7e-253d-49a4-acbc-4db0a3f5745b req-9c3d71a7-a477-4354-85e1-88293c7a872f service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 973.169171] env[66919]: INFO networking_nsxv3.common.synchronization [req-e7c27b7e-253d-49a4-acbc-4db0a3f5745b req-9c3d71a7-a477-4354-85e1-88293c7a872f service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 973.169171] env[66919]: INFO networking_nsxv3.common.synchronization [req-e7c27b7e-253d-49a4-acbc-4db0a3f5745b req-9c3d71a7-a477-4354-85e1-88293c7a872f service nova] Enqueued Resource ID: ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 with Priority: HIGHEST for action port [ 973.169171] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 973.169853] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 973.170141] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 with Priority: HIGHEST for action port [ 973.171392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.171918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.172193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.172648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.172862] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.174073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.174374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.174542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.175016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.176279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.176279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.176279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.176279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.176279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.176279] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.177509] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.178085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.178354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.179613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.179613] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea104c4f-74f8-45ab-a6f1-12a40ef3ab33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.393920] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.449256] env[66919]: INFO networking_nsxv3.common.synchronization [req-b343367a-3a30-43cd-be3a-8c99ef827cb7 req-8e2460ae-daa6-4010-8fc8-513d6d888c71 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 973.449860] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 973.450518] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.450672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.450753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.452208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.452208] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.452208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.452208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.452208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.452208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.452208] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.678149] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.687034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.687034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 with status ACTIVE [ 973.687034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.687034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.687034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.687034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.687733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.687733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.687733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.687733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.687733] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea104c4f-74f8-45ab-a6f1-12a40ef3ab33 is going to be updated. [ 973.725225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.725993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.725993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.725993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.725993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.726251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea104c4f-74f8-45ab-a6f1-12a40ef3ab33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.900436] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.902701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.902701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.902701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.902701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.902701] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 973.955096] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.955096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.955096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.955096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.956287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.958541] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.959252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.959576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.960634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.960634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.961193] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.961895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.961895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.962885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.963123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.963246] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da753667-590d-44b7-b73e-76baaab11b84 already deleted. [ 973.963357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.969293] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.969293] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.969293] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.969293] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.969293] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.969293] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.969293] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.970094] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.970094] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.970094] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.986955] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 974.003399] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.003652] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.003805] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.004071] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.004515] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-fc23df60-90c0-4ccf-b4e0-f516521125f7 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.004732] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.004833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.006315] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.006505] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc23df60-90c0-4ccf-b4e0-f516521125f7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.105462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 in Status: SUCCESS [ 974.105679] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 deletion is rescheduled due to dependency. [ 974.105806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.185230] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.509041] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.509305] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.509422] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.509729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.509880] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.510049] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port fc23df60-90c0-4ccf-b4e0-f516521125f7 not found, creating... [ 974.510428] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.510536] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.510580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.510783] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.510913] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.511213] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.511369] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.511584] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.512255] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.512500] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.512688] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: fc23df60-90c0-4ccf-b4e0-f516521125f7 is going to be created. [ 974.549636] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.549900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.550040] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.550317] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.550549] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.550927] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.688918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.689184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.689253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.689446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.689590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.689726] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 974.721687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.721858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.721907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.722119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.722268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.732862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 974.753321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c38fec75-1824-4123-9a27-d70b3e15c2bc in Status: SUCCESS [ 974.753537] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc deletion is rescheduled due to dependency. [ 974.753594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.262261] env[66919]: INFO networking_nsxv3.common.synchronization [req-b343367a-3a30-43cd-be3a-8c99ef827cb7 req-cfe78eb6-56c6-42b9-bfac-306fb7bc93db service nova] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 975.262625] env[66919]: INFO networking_nsxv3.common.synchronization [req-b343367a-3a30-43cd-be3a-8c99ef827cb7 req-cfe78eb6-56c6-42b9-bfac-306fb7bc93db service nova] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 975.262837] env[66919]: INFO networking_nsxv3.common.synchronization [req-b343367a-3a30-43cd-be3a-8c99ef827cb7 req-cfe78eb6-56c6-42b9-bfac-306fb7bc93db service nova] Enqueued Resource ID: fc23df60-90c0-4ccf-b4e0-f516521125f7 with Priority: HIGHEST for action port [ 975.263491] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_rules [ 975.263703] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 975.263834] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc23df60-90c0-4ccf-b4e0-f516521125f7 with Priority: HIGHEST for action port [ 975.264229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.264356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.264423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.264693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.264778] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.265703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.265870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.265953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.266148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.266297] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.266391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.267266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.267266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.267266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.267485] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.269472] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc23df60-90c0-4ccf-b4e0-f516521125f7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.269472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.269472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.269862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.269862] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc23df60-90c0-4ccf-b4e0-f516521125f7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.629451] env[66919]: INFO networking_nsxv3.common.synchronization [req-f4740df4-9787-4dff-9525-391b00cb9af6 req-14e75d5b-40d0-4445-a7cb-610afee9b5d3 tempest-ServersWithSpecificFlavorTestJSON-982754489 tempest-ServersWithSpecificFlavorTestJSON-982754489-project-member] Enqueued Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 975.629451] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 with Priority: HIGHEST for action security_group_members [ 975.629451] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-07ef1b9b-e982-41f7-a4f6-a3caf8809311 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.630266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.630492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.630869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.631170] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.631474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.631763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.633250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.633250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.633250] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07ef1b9b-e982-41f7-a4f6-a3caf8809311',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.775063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775063] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.775063] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc23df60-90c0-4ccf-b4e0-f516521125f7 with status ACTIVE [ 975.775063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.775063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.775063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.775699] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.775699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.775699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.775699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.776223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.776847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc23df60-90c0-4ccf-b4e0-f516521125f7 is going to be updated. [ 975.815867] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.816165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.816165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.816343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.817041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.817237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc23df60-90c0-4ccf-b4e0-f516521125f7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.998443] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 975.998703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.998920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.999118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.999392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.999513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.999513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.999667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.999753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.999841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.999954] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.135117] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.135280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.135351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.135577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.154954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.155239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.155361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.155427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.155630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.155708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.155798] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 is going to be updated. [ 976.180788] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.180978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.180978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.181151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.181299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.189969] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: IN_PROGRESS for 2s [ 976.280287] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.502957] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.503236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.503357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.503542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.503695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.503795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.503847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.504016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.504133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.504186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.504337] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.504427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.504530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.504741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.504868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.504868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.504969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.505216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.505216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.505216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.505397] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.743042] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 976.743270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.743439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.743653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.743842] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.743953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.744026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.744179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.744258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.744339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.744424] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.785290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.785446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.785534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.785838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.785936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.786066] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da753667-590d-44b7-b73e-76baaab11b84 is going to be created. [ 976.813228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.813364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.813430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.813662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.813843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.825208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: UNINITIALIZED for 2s [ 977.007974] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 977.028857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.029070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.029629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.029629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.053457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.053725] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.053878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.053950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.054175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.054292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.056376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.056376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.056376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.056376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.056376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.058146] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.058908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.058908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.058908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.059131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.059131] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 977.162976] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.163156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.163255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.163550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.163791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.185769] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 977.248328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.248664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.248777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.249161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.249433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.249554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.249621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.249836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.249946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.250122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.250253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.250352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.250415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.250586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.250729] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.250831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.250888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.252474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.252569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.252668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.252766] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.755121] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8993b03-159d-4cb8-a490-873c724e7d28: rpc.has_security_group_logging(os_id): False [ 977.776944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.776944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.776944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.776944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.778090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.778090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.778090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.778090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.778090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.778090] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 977.842233] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.843262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.843414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.843722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.843932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.858455] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 978.204272] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 in Status: SUCCESS [ 978.204512] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07ef1b9b-e982-41f7-a4f6-a3caf8809311 deletion is rescheduled due to dependency. [ 978.204582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07ef1b9b-e982-41f7-a4f6-a3caf8809311" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.836896] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: SUCCESS [ 978.836896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.837295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.837295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.837548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.837695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.837763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.837938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.838072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.838167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.838259] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.134015] env[66919]: INFO networking_nsxv3.common.synchronization [req-bf3fcb79-bb9c-4dbc-b6a7-61d3728d798d req-fc49eda4-3cf7-419e-b5ec-34f32160d039 tempest-DeleteServersAdminTestJSON-765803948 tempest-DeleteServersAdminTestJSON-765803948-project-member] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 979.134465] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGHEST for action security_group_members [ 979.135907] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.135907] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.135907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.135907] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.206970] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 979.207258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.340325] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.638034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.638034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.638183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.638381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.638456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.638613] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.638722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.638869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.638929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.638977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.639301] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be updated. [ 979.670827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.671019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.671071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.671284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.671542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.680844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: IN_PROGRESS for 2s [ 979.844391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da753667-590d-44b7-b73e-76baaab11b84: rpc.has_security_group_logging(os_id): False [ 979.866372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.866651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.866651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.866921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.867021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.867290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.867398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.867473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.867687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.868032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.868032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da753667-590d-44b7-b73e-76baaab11b84 is going to be created. [ 979.876013] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 979.876604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.936619] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.936785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.936785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.936993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.937196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.953845] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: IN_PROGRESS for 2s [ 980.517263] env[66919]: INFO networking_nsxv3.common.synchronization [req-c669b399-74e1-4912-933e-f069808560e4 req-02027d9b-2394-4c06-9d7c-7b7ecf3ecd00 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 980.517263] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 980.517563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.517685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.517752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.517955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.518410] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.519102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.519102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.519102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.519256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.520050] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.024964] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.025389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.025389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.025602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.050567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.050899] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.051041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.051135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.051330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.051406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.051490] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 981.080354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.080354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.080354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.080354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.080354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.093018] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 981.692280] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 in Status: SUCCESS [ 981.692454] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 deletion is rescheduled due to dependency. [ 981.692568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.967736] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: SUCCESS [ 981.968191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.894554] env[66919]: INFO networking_nsxv3.common.synchronization [None req-08369966-fd4f-4536-813e-495c401669d2 None None] Enqueued Resource ID: 2d3c9a70-e8b0-4b08-94e8-50b20fcab172 with Priority: HIGHEST for action port [ 982.895226] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d3c9a70-e8b0-4b08-94e8-50b20fcab172 with Priority: HIGHEST for action port [ 982.895535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d3c9a70-e8b0-4b08-94e8-50b20fcab172 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.895680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d3c9a70-e8b0-4b08-94e8-50b20fcab172" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.895746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d3c9a70-e8b0-4b08-94e8-50b20fcab172" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.896562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d3c9a70-e8b0-4b08-94e8-50b20fcab172" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.896714] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d3c9a70-e8b0-4b08-94e8-50b20fcab172',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.105016] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 983.106501] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 983.106667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.399391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d3c9a70-e8b0-4b08-94e8-50b20fcab172 [ 983.399948] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.400225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.400341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.400875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.400875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.400875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d3c9a70-e8b0-4b08-94e8-50b20fcab172 already deleted. [ 983.400875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d3c9a70-e8b0-4b08-94e8-50b20fcab172" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.940166] env[66919]: INFO networking_nsxv3.common.synchronization [req-11183bec-46c2-4bca-a32a-5480694d0edd req-d12c5776-8896-4bd5-aecc-8e20dbbc9337 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 984.941304] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 984.941304] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.941304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.941304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.941534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.941627] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.941721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.941784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.941910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.941988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.942169] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.426700] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-839 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.426700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.426700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.427093] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.427236] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.427403] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.427542] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.427779] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.427945] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.428425] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.428425] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.428425] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.428861] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.428861] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.428861] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.428998] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.444926] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.445168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.445237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.445606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.445742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.446058] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.446209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.446282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.446509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.446799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.446942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 985.453235] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.453424] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.453649] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.453845] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-839" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.454176] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.454362] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.454516] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.454835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.454972] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6128a6-a135-4a1f-893e-9d1de9c5b8bd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.479470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.479891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.479891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.480064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.480204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.493066] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 985.957611] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.957898] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.958712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.958712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.958712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.958712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd not found, creating... [ 985.959337] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.959612] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.959739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.959981] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.960141] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.960452] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.960610] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.960724] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.960937] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.961259] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.961495] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd is going to be created. [ 985.985109] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.985109] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.986511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.986511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.986511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.986511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.325311] env[66919]: INFO networking_nsxv3.common.synchronization [None req-8f6debad-61a1-4d81-b66f-6a89606bc7d6 None None] Enqueued Resource ID: 1b90da32-e983-4e6b-9b80-646a4702845d with Priority: HIGHEST for action port [ 986.327406] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b90da32-e983-4e6b-9b80-646a4702845d with Priority: HIGHEST for action port [ 986.328957] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1b90da32-e983-4e6b-9b80-646a4702845d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.328957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1b90da32-e983-4e6b-9b80-646a4702845d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.328957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1b90da32-e983-4e6b-9b80-646a4702845d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.328957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1b90da32-e983-4e6b-9b80-646a4702845d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.328957] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1b90da32-e983-4e6b-9b80-646a4702845d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.822563] env[66919]: INFO networking_nsxv3.common.synchronization [req-11183bec-46c2-4bca-a32a-5480694d0edd req-57cebef5-ac49-4ea3-9ec1-dec9336cc469 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 986.822776] env[66919]: INFO networking_nsxv3.common.synchronization [req-11183bec-46c2-4bca-a32a-5480694d0edd req-57cebef5-ac49-4ea3-9ec1-dec9336cc469 service nova] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 986.822929] env[66919]: INFO networking_nsxv3.common.synchronization [req-11183bec-46c2-4bca-a32a-5480694d0edd req-57cebef5-ac49-4ea3-9ec1-dec9336cc469 service nova] Enqueued Resource ID: 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd with Priority: HIGHEST for action port [ 986.823658] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_rules [ 986.823814] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 986.823954] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd with Priority: HIGHEST for action port [ 986.828380] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.828521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.828599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.828829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.828909] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.830525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.830525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.830525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.830525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.830525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.834206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.834206] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f6128a6-a135-4a1f-893e-9d1de9c5b8bd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.834206] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1b90da32-e983-4e6b-9b80-646a4702845d [ 986.834206] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.834206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.834206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.834206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.834729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.834729] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1b90da32-e983-4e6b-9b80-646a4702845d already deleted. [ 986.834729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1b90da32-e983-4e6b-9b80-646a4702845d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.333631] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.333915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.335283] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd with status ACTIVE [ 987.335423] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.335549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.335621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.336029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.336140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.336333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.336514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.336588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.336830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.336917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.337126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.337253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.337317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.337465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.337538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.337623] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f6128a6-a135-4a1f-893e-9d1de9c5b8bd is going to be updated. [ 987.361924] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.361924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.361924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.361924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.361924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.361924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f6128a6-a135-4a1f-893e-9d1de9c5b8bd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.509189] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 987.509290] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 987.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.509564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.509788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.509990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.510121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.510196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.510367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.510455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.510547] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.012735] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.518242] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.024282] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.024953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.024953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.025528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.025528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.025528] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 989.063818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.064660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.064660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.064660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.064660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.074729] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 989.117693] env[66919]: INFO networking_nsxv3.common.synchronization [req-e8fe0127-88fc-4cb7-bc50-1bb49920512d req-15e7245e-d5e5-4234-a5f9-10a11aa42b6a tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 989.118301] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 989.118610] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.118729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.118817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.120285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.120398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.120476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.120546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.120701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.120790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.120884] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.516074] env[66919]: INFO networking_nsxv3.common.synchronization [None req-73065b75-4459-4d6e-80a4-71f47862667e tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 989.516715] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 989.517116] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.517552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.623623] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.697447] env[66919]: INFO networking_nsxv3.common.synchronization [req-0fb2bbdc-e501-42c9-b220-2ae69c9b76e2 req-270fa00b-8547-4740-8a3f-d48d6953fade tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 989.698864] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 989.699295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.699424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.699481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.699807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.699978] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.700102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.700163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.700689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.700689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.700689] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.023024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.023024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.023024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.023024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.023024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.023437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.023908] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.028026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.028026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.028026] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.028026] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.028026] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.028026] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.028026] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.028026] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.028026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.044936] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.046050] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.046656] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.047073] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.047491] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-e684f63b-e50f-43b9-b243-6ef85236c4ae taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.048292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.048292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.048292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.048713] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e684f63b-e50f-43b9-b243-6ef85236c4ae',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.110560] env[66919]: INFO networking_nsxv3.common.synchronization [None req-589bda01-b881-45bc-bec6-a3437da466c1 None None] Enqueued Resource ID: a9c0b670-3f7e-4c5b-a315-33f3403017b4 with Priority: HIGHEST for action port [ 990.111105] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9c0b670-3f7e-4c5b-a315-33f3403017b4 with Priority: HIGHEST for action port [ 990.111484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9c0b670-3f7e-4c5b-a315-33f3403017b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.111654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9c0b670-3f7e-4c5b-a315-33f3403017b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.111936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9c0b670-3f7e-4c5b-a315-33f3403017b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.112249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9c0b670-3f7e-4c5b-a315-33f3403017b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.112536] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9c0b670-3f7e-4c5b-a315-33f3403017b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.125023] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.203101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.203264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.203328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.203550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.203622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.203803] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.203901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.203953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.204118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.204196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.204298] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 already deleted. [ 990.204512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.551362] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.551590] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.551712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.551993] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.552172] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.552347] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port e684f63b-e50f-43b9-b243-6ef85236c4ae not found, creating... [ 990.552613] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.552766] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.552880] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.553112] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.553249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.553531] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.553682] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.553800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.554009] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.554144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.554303] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: e684f63b-e50f-43b9-b243-6ef85236c4ae is going to be created. [ 990.577932] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.578169] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.578301] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.578658] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.578981] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.579238] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.614870] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9c0b670-3f7e-4c5b-a315-33f3403017b4 [ 990.615108] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.615426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.615426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.615600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.615659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.615757] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9c0b670-3f7e-4c5b-a315-33f3403017b4 already deleted. [ 990.615841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9c0b670-3f7e-4c5b-a315-33f3403017b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.627533] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.627824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.627824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.627970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.628082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.628189] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 990.680703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.681947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.682063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.682320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.682524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.704167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 990.817482] env[66919]: INFO networking_nsxv3.common.synchronization [req-137203fb-c1e1-4444-84e0-6ec6e01ca733 req-62c9eed6-63ce-4d27-9664-28f614dd9a3a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 990.817937] env[66919]: INFO networking_nsxv3.common.synchronization [req-137203fb-c1e1-4444-84e0-6ec6e01ca733 req-62c9eed6-63ce-4d27-9664-28f614dd9a3a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 990.817937] env[66919]: INFO networking_nsxv3.common.synchronization [req-137203fb-c1e1-4444-84e0-6ec6e01ca733 req-62c9eed6-63ce-4d27-9664-28f614dd9a3a tempest-SecurityGroupsTestJSON-1483456718 tempest-SecurityGroupsTestJSON-1483456718-project-member] Enqueued Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 990.818422] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a with Priority: HIGHEST for action security_group_members [ 990.818568] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGHEST for action security_group_members [ 990.818665] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGHEST for action security_group_members [ 990.818947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.819081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.819157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.819351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.819506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.819609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.819667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.819817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.819903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.820214] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.823031] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.823475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.823475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.823591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.823735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.823837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.823897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.824067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.824154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.824568] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.825549] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.825549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.825549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.825674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.825865] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.825865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.825997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.826069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.826169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.826378] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.085036] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 991.085318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.086045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.086173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.086415] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.086568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.086662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.086858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.086976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.087108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.087231] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.326270] env[66919]: INFO networking_nsxv3.common.synchronization [req-0fb2bbdc-e501-42c9-b220-2ae69c9b76e2 req-8a3397cb-2ac0-4e16-9949-f0130b7307a3 service nova] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 991.326437] env[66919]: INFO networking_nsxv3.common.synchronization [req-0fb2bbdc-e501-42c9-b220-2ae69c9b76e2 req-8a3397cb-2ac0-4e16-9949-f0130b7307a3 service nova] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 991.326607] env[66919]: INFO networking_nsxv3.common.synchronization [req-0fb2bbdc-e501-42c9-b220-2ae69c9b76e2 req-8a3397cb-2ac0-4e16-9949-f0130b7307a3 service nova] Enqueued Resource ID: e684f63b-e50f-43b9-b243-6ef85236c4ae with Priority: HIGHEST for action port [ 991.327196] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_rules [ 991.327329] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 991.327424] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e684f63b-e50f-43b9-b243-6ef85236c4ae with Priority: HIGHEST for action port [ 991.327703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.327835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.327901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.329309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.329379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.331546] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.331546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.331546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.331988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.332134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.332367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.332367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.332498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.332579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.332666] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.334332] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.335318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.336048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.336048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.336048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.336048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.336048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.336048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.336383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.336383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.336383] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be updated. [ 991.339651] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e684f63b-e50f-43b9-b243-6ef85236c4ae taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.339651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.339651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.339651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.339651] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e684f63b-e50f-43b9-b243-6ef85236c4ae',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.340366] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.341423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.341499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.341686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.344315] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.344315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.364857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.364857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.364857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.364857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.364857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.364857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.365169] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a is going to be updated. [ 991.367204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.367419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.377678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.377820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.377893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.378118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.378261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.387986] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: IN_PROGRESS for 2s [ 991.399373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.399568] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.399701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.399758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.399956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.400777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.400908] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 is going to be updated. [ 991.405470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.405470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.405470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.405470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.405470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.417552] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: IN_PROGRESS for 2s [ 991.440070] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.440291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.440448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.440634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.440829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.456654] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: IN_PROGRESS for 2s [ 991.590836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.590836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.590836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.592085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.592274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.592602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.592602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.592750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.592797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.592933] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.593770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.593770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.593770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.593770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.593770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.593770] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.842838] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.842838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.842838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.844544] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e684f63b-e50f-43b9-b243-6ef85236c4ae with status ACTIVE [ 991.846637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.846637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.846637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.847626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.847626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.847626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.847738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.847871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.851020] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e684f63b-e50f-43b9-b243-6ef85236c4ae is going to be updated. [ 991.876495] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.876760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.876893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.877336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.877642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.877902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e684f63b-e50f-43b9-b243-6ef85236c4ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.000827] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f638a81e-19a8-4bcf-9b59-9adf6e6ca144 tempest-ServerActionsV293TestJSON-87740859 tempest-ServerActionsV293TestJSON-87740859-project-member] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 992.003345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 992.003606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.004139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.004139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.004139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.004658] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.102131] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5: rpc.has_security_group_logging(os_id): False [ 992.111640] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b070f1dd-a12c-4161-ad79-1ff1cdf19f74 tempest-ServerActionsV293TestJSON-87740859 tempest-ServerActionsV293TestJSON-87740859-project-member] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 992.112183] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 992.112590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.112650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.120045] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.120194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.120262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.120481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.120573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.120767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.120863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.120943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.121140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.121171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.121326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.121418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.121493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.121664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.121664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.121853] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.121945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.122124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.122326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.122573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.122573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 992.188167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.188636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.188636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.188636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.188761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.202232] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 992.343369] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.529894] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.530467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.530467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.530467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.530467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.530467] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 already deleted. [ 992.531237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.531237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.531237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.531237] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.714687] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.714687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.714687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.714687] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.847621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.847973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.847973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.850411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.850542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.850707] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 is going to be created. [ 992.880833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.882975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.882975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.882975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.882975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.894078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: UNINITIALIZED for 2s [ 993.055418] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.055579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.055707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.056066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.056195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.056284] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 already deleted. [ 993.056431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.089381] env[66919]: INFO networking_nsxv3.common.synchronization [None req-da623401-5583-4b6a-8c6e-8a54b56492aa None None] Enqueued Resource ID: b91b7b81-49a2-42e6-8315-602fdf4442d3 with Priority: HIGHEST for action port [ 993.090122] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b91b7b81-49a2-42e6-8315-602fdf4442d3 with Priority: HIGHEST for action port [ 993.090457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b91b7b81-49a2-42e6-8315-602fdf4442d3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.090600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b91b7b81-49a2-42e6-8315-602fdf4442d3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.090743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b91b7b81-49a2-42e6-8315-602fdf4442d3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.091008] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b91b7b81-49a2-42e6-8315-602fdf4442d3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.093079] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b91b7b81-49a2-42e6-8315-602fdf4442d3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.219355] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.219648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.219648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.220177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.220279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220494] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.220599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.220662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.220866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.220912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.220965] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 993.251413] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.251580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.251649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.251851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.251987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.265900] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 993.399100] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b279846-5f96-463a-ab8f-df707aa1a846 in Status: SUCCESS [ 993.399344] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 deletion is rescheduled due to dependency. [ 993.399401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.428264] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a in Status: SUCCESS [ 993.428264] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a deletion is rescheduled due to dependency. [ 993.428264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.469084] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d72e45fa-d666-4664-a812-3413fb67c0b4 in Status: SUCCESS [ 993.469084] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 deletion is rescheduled due to dependency. [ 993.469084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.593591] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b91b7b81-49a2-42e6-8315-602fdf4442d3 [ 993.594254] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.594254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.594254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.594501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.594501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.594501] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b91b7b81-49a2-42e6-8315-602fdf4442d3 already deleted. [ 993.594626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b91b7b81-49a2-42e6-8315-602fdf4442d3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.982262] env[66919]: INFO networking_nsxv3.common.synchronization [req-c196aff9-e63e-46cb-b69f-75317b23cc7c req-7033879f-e660-42c0-be62-2e7dab838241 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 993.982820] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af639ee4-0cf3-4378-b556-ae5617090112 with Priority: HIGHEST for action security_group_members [ 993.983221] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-af639ee4-0cf3-4378-b556-ae5617090112 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.983367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.983435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.983668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.984262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.984404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.984473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.984654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.984752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.984865] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af639ee4-0cf3-4378-b556-ae5617090112',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.220199] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 994.220457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.488045] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.488045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.488319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.488355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.510530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.510843] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.511286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.511286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.512431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.512431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.512431] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af639ee4-0cf3-4378-b556-ae5617090112 is going to be updated. [ 994.556525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.557264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.557363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.558025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.558025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.567664] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: IN_PROGRESS for 2s [ 994.910143] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: SUCCESS [ 994.910368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.910548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.910902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.911229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.911423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.911543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.911776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.911916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.912089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.912338] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.275888] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 995.275888] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 deletion is rescheduled due to dependency. [ 995.276306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.419061] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.922068] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333: rpc.has_security_group_logging(os_id): False [ 995.946339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.946542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.946624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.946858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.946965] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.947266] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.947369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.947408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.947562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.947636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.947720] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 is going to be created. [ 996.026212] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.026538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.026721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.027615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.027615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.042703] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: IN_PROGRESS for 2s [ 996.579977] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af639ee4-0cf3-4378-b556-ae5617090112 in Status: SUCCESS [ 996.580447] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af639ee4-0cf3-4378-b556-ae5617090112 deletion is rescheduled due to dependency. [ 996.580447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af639ee4-0cf3-4378-b556-ae5617090112" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.056341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: SUCCESS [ 998.056657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.984032] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 998.984213] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 999.826670] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 999.826670] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:2 started [ 999.914028] env[66919]: INFO networking_nsxv3.common.synchronization [None req-bf06b859-3dd0-43eb-a26c-fbcee2244d12 None None] Enqueued Resource ID: a7d4f347-729e-4a23-bed2-3dd83f107f48 with Priority: HIGHEST for action port [ 999.914028] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7d4f347-729e-4a23-bed2-3dd83f107f48 with Priority: HIGHEST for action port [ 999.914606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7d4f347-729e-4a23-bed2-3dd83f107f48 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.914760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7d4f347-729e-4a23-bed2-3dd83f107f48" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.914947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7d4f347-729e-4a23-bed2-3dd83f107f48" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.915640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7d4f347-729e-4a23-bed2-3dd83f107f48" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.915729] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7d4f347-729e-4a23-bed2-3dd83f107f48',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.417965] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7d4f347-729e-4a23-bed2-3dd83f107f48 [ 1000.418381] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.418381] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.418525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.418629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.418716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.418811] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7d4f347-729e-4a23-bed2-3dd83f107f48 already deleted. [ 1000.418889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7d4f347-729e-4a23-bed2-3dd83f107f48" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.489441] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ca7a0671-4e1e-4475-9721-05212caf6587 None None] Enqueued Resource ID: 94bed1cf-8402-40df-a702-6028ebec54ae with Priority: HIGHEST for action port [ 1002.490296] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94bed1cf-8402-40df-a702-6028ebec54ae with Priority: HIGHEST for action port [ 1002.490296] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-94bed1cf-8402-40df-a702-6028ebec54ae taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.490296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94bed1cf-8402-40df-a702-6028ebec54ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.490601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94bed1cf-8402-40df-a702-6028ebec54ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.490718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94bed1cf-8402-40df-a702-6028ebec54ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.491699] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94bed1cf-8402-40df-a702-6028ebec54ae',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.993550] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 94bed1cf-8402-40df-a702-6028ebec54ae [ 1002.993787] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.993925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.993995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.995097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.995097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.995097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:94bed1cf-8402-40df-a702-6028ebec54ae already deleted. [ 1002.995097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94bed1cf-8402-40df-a702-6028ebec54ae" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.190348] env[66919]: INFO networking_nsxv3.common.synchronization [req-f07f96aa-ad79-4955-9fb3-a764552f5dde req-1e24856f-53d1-43ad-8ab4-032ac46c0e16 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1003.190348] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1003.191829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.191829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.191829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.191829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.192051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.192099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.193099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.193099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.193099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.193099] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.695480] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.198469] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.207820] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.208060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.208342] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.208516] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.209439] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.209439] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.211587] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.212148] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.213386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.214285] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.215077] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.215077] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.215077] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.215077] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.215077] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.215077] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.242697] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.242895] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.243121] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.243234] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.243574] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.243753] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.243869] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.244816] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.245111] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a9454b-71a2-42d5-b3e9-61601f9cee7d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.703367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.703367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.703367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.703367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.703367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.703367] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1004.733328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.733723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.733723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.733811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.733896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.745473] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1004.748188] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.748405] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.748528] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.748799] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.748951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.749332] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port b4a9454b-71a2-42d5-b3e9-61601f9cee7d not found, creating... [ 1004.749410] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.749521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.749638] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.749896] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.749983] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.750272] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.750428] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.750600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.750823] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.750969] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.751858] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: b4a9454b-71a2-42d5-b3e9-61601f9cee7d is going to be created. [ 1004.774945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.774945] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.774945] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.774945] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.775429] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.775738] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.279985] env[66919]: INFO networking_nsxv3.common.synchronization [req-ee9ba52d-0559-48d5-8cca-7792eb96a9c0 req-eb03ea73-7772-4d63-9773-d4c36aaa56cb tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1005.280583] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1005.280898] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.281129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.281339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.281586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.281763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.281875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.281935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.282128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.282236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.282413] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.554976] env[66919]: INFO networking_nsxv3.common.synchronization [req-f07f96aa-ad79-4955-9fb3-a764552f5dde req-4defb005-8031-4e8f-8b38-f793a6a7e37d service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1005.555312] env[66919]: INFO networking_nsxv3.common.synchronization [req-f07f96aa-ad79-4955-9fb3-a764552f5dde req-4defb005-8031-4e8f-8b38-f793a6a7e37d service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1005.555522] env[66919]: INFO networking_nsxv3.common.synchronization [req-f07f96aa-ad79-4955-9fb3-a764552f5dde req-4defb005-8031-4e8f-8b38-f793a6a7e37d service nova] Enqueued Resource ID: b4a9454b-71a2-42d5-b3e9-61601f9cee7d with Priority: HIGHEST for action port [ 1005.556263] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1005.556486] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1005.556616] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a9454b-71a2-42d5-b3e9-61601f9cee7d with Priority: HIGHEST for action port [ 1005.557020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.557184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.557305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.557595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.558312] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.560841] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.561827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.561827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.561827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.561827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.562047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.562047] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4a9454b-71a2-42d5-b3e9-61601f9cee7d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.785928] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.785928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.785928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.785928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.788282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.788282] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.788282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.788282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.788282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.788282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.788282] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1005.831264] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.831414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.831485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.831705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.831850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.843590] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1005.936741] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.936977] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.937090] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.937341] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.937604] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.937789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.937884] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.938194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.938292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.938511] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.938638] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.938804] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.938859] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.939436] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.939436] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.939436] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.961090] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.961279] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.961415] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.961588] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.961936] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-0785931a-dc55-4e74-a1a0-cbd57f979a90 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.962144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.962266] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.962613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.962746] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0785931a-dc55-4e74-a1a0-cbd57f979a90',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.063905] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.064126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.065459] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4a9454b-71a2-42d5-b3e9-61601f9cee7d with status ACTIVE [ 1006.065675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.065799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.065863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.066096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.066193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.066390] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.066494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.066556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.066716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.066792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.066980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.067170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.067170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.067276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.067350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.067436] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4a9454b-71a2-42d5-b3e9-61601f9cee7d is going to be updated. [ 1006.088191] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.088366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.088408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.088599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.088731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.088890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4a9454b-71a2-42d5-b3e9-61601f9cee7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.467485] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.467772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.467869] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.468600] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.468772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.468939] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 0785931a-dc55-4e74-a1a0-cbd57f979a90 not found, creating... [ 1006.469239] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.469399] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.469514] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.469746] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.469876] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.470799] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.470977] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.471110] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.471356] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.471527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.471701] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 0785931a-dc55-4e74-a1a0-cbd57f979a90 is going to be created. [ 1006.498186] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.498511] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.498661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.498963] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.499226] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.499461] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.756882] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1006.756954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.757148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.757375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.757559] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.757674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.757740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.758183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.758183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.758183] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.182485] env[66919]: INFO networking_nsxv3.common.synchronization [req-ee9ba52d-0559-48d5-8cca-7792eb96a9c0 req-d48f8e65-2ba0-47ac-a50e-886153324fe8 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1007.182763] env[66919]: INFO networking_nsxv3.common.synchronization [req-ee9ba52d-0559-48d5-8cca-7792eb96a9c0 req-d48f8e65-2ba0-47ac-a50e-886153324fe8 service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1007.182842] env[66919]: INFO networking_nsxv3.common.synchronization [req-ee9ba52d-0559-48d5-8cca-7792eb96a9c0 req-d48f8e65-2ba0-47ac-a50e-886153324fe8 service nova] Enqueued Resource ID: 0785931a-dc55-4e74-a1a0-cbd57f979a90 with Priority: HIGHEST for action port [ 1007.183508] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1007.184106] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1007.184263] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0785931a-dc55-4e74-a1a0-cbd57f979a90 with Priority: HIGHEST for action port [ 1007.184584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.184717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.184797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.185071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.185183] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.186097] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.186232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.186474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0785931a-dc55-4e74-a1a0-cbd57f979a90 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.186591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.186660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.186852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.186930] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0785931a-dc55-4e74-a1a0-cbd57f979a90',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.261824] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.689720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.689898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.690054] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0785931a-dc55-4e74-a1a0-cbd57f979a90 with status ACTIVE [ 1007.690229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.690339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.690406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.690612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.690704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.690875] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.690970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.691054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.691448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.691448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.691546] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.691636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.691698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.691852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.691947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.692051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0785931a-dc55-4e74-a1a0-cbd57f979a90 is going to be updated. [ 1007.716437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.716579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.716688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.716865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.717081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.717266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0785931a-dc55-4e74-a1a0-cbd57f979a90" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.763811] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.852163] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-19a5fcc5-bd11-4d7e-81bc-2a7f6962f07a tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1007.853153] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1007.853474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.853596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.853728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.853930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.854359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.854469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.854560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.854779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.854874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.855034] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.856838] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1007.857022] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1007.857155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.857631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.858125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.858284] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.858527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.858586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.858749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.858859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.858914] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.247811] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-bdbe10ba-8fe3-4054-9ec9-3b4e9f292632 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1008.248484] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1008.250592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.250741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.266192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.266359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.266469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.266612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.266701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.266801] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1008.319713] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.319901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.319950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.320175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.320324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.338897] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1008.360748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.360894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.360968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.361234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.361336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.361529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.361644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.361715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.362039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.362039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.362039] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 already deleted. [ 1008.362191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.362311] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.363136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.363300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.363448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.363546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.363608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.363745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.363818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.363900] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.549683] env[66919]: INFO networking_nsxv3.common.synchronization [None req-18e8539b-8a97-4efa-b166-5e6260749cbe None None] Enqueued Resource ID: 5be447b1-4bba-4aa6-8ac1-b60b85f42407 with Priority: HIGHEST for action port [ 1008.551143] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5be447b1-4bba-4aa6-8ac1-b60b85f42407 with Priority: HIGHEST for action port [ 1008.551143] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5be447b1-4bba-4aa6-8ac1-b60b85f42407 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.551143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5be447b1-4bba-4aa6-8ac1-b60b85f42407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.551143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5be447b1-4bba-4aa6-8ac1-b60b85f42407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.551143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5be447b1-4bba-4aa6-8ac1-b60b85f42407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.551143] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5be447b1-4bba-4aa6-8ac1-b60b85f42407',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.654767] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-9c9c10f5-11ab-4b94-a575-b0a16d4a1539 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1008.655431] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1008.656090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.656203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.869807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.869807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.869807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.869807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.871174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.871709] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 already deleted. [ 1008.871709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.872655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.872655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.873426] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.875248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.875248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.875248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.875248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.875248] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.053753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5be447b1-4bba-4aa6-8ac1-b60b85f42407 [ 1009.054056] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.054183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.054241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.054618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.054770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.054914] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5be447b1-4bba-4aa6-8ac1-b60b85f42407 already deleted. [ 1009.055033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5be447b1-4bba-4aa6-8ac1-b60b85f42407" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.122119] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-776 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.122333] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.122456] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.122798] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.123097] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.123265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.123379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.123605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.123754] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.124018] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.124333] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1009.124463] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1009.124577] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1009.124693] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1009.124801] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1009.124968] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1009.146409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1009.146705] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1009.146924] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1009.147243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.147665] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-2b5b6f94-973c-4788-848a-3663ae77213b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.147963] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.149198] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.149547] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.149753] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5b6f94-973c-4788-848a-3663ae77213b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.376194] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.376194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.376194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.376194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.376194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.376194] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1009.380439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.380800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.380964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.381267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.381508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.381873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.382689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.382689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.382689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.382689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.382689] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 already deleted. [ 1009.382689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.417271] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.417463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.417571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.417830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.417989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.429897] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1009.654193] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.654541] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.654541] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.654798] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.654947] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.655117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 2b5b6f94-973c-4788-848a-3663ae77213b not found, creating... [ 1009.655373] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.655527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.655644] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.655881] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.656031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.656319] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.656476] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.656574] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.656777] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.656906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.657166] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 2b5b6f94-973c-4788-848a-3663ae77213b is going to be created. [ 1009.680434] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.680619] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.680737] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.681027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.681259] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.681472] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.028118] env[66919]: INFO networking_nsxv3.common.synchronization [req-e10f8859-071f-4022-8e3a-41469130b9b5 req-2fabf3bd-921e-4a86-b243-9760d0fd6094 tempest-ImagesTestJSON-1582691790 tempest-ImagesTestJSON-1582691790-project-member] Enqueued Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 1010.028118] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 with Priority: HIGHEST for action security_group_members [ 1010.028118] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.028118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.028118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.028363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.028451] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.028599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.028683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.028870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.028982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.029144] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.352015] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1010.352015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.352015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.352015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.352015] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.352549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.352549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.352549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.352549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.352549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.352805] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.491276] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-12a56a4b-884d-4b2e-b0dd-47c67131de14 service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1010.491276] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-12a56a4b-884d-4b2e-b0dd-47c67131de14 service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1010.491276] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-12a56a4b-884d-4b2e-b0dd-47c67131de14 service nova] Enqueued Resource ID: 2b5b6f94-973c-4788-848a-3663ae77213b with Priority: HIGHEST for action port [ 1010.492631] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1010.493390] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1010.494598] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b5b6f94-973c-4788-848a-3663ae77213b with Priority: HIGHEST for action port [ 1010.495267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.495551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.495723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.496098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.496276] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.497328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.498752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.498925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.502021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.502021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.502021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b5b6f94-973c-4788-848a-3663ae77213b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.502021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.502021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b5b6f94-973c-4788-848a-3663ae77213b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.530797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.530956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.531037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.531237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.531318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.531512] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.531635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.531748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.532296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.533887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.533981] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 is going to be updated. [ 1010.583395] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.583597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.583661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.583898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.584237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.596334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: IN_PROGRESS for 2s [ 1010.855745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.855956] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.856025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.856363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.856656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.856656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.856656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.856852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.856852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.856966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.857148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.857266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.857266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.857425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.857565] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.857652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.857719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.857911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.858251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.858251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.858251] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.006237] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.006563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.007270] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.007688] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b5b6f94-973c-4788-848a-3663ae77213b with status ACTIVE [ 1011.007839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.007928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.007980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.008237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.008304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.008474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.008573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.008626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.008777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.008870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.009990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.010241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.010241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.010460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.010532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.010638] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b5b6f94-973c-4788-848a-3663ae77213b is going to be updated. [ 1011.035950] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.036125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.036184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.036414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.037042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.037042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b5b6f94-973c-4788-848a-3663ae77213b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.360142] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 1011.385537] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-348 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.385688] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-348" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.388557] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-348" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.389331] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-348" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.389593] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.389889] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.390034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.390290] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.390437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.390655] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.390761] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.391205] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.391205] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.391205] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.391205] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.391479] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.393203] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.393330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.393377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.393897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.393897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.393897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.394192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.394192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.394192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.394284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.394444] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.394541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.394598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.394736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.394894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.398363] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.398462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.398462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.398658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.398749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.398851] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1011.425970] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.426154] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.426462] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.426749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-348" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.427086] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-c2e3dd29-d25c-42d8-8457-59dc0e66f683 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.427263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.427375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.427729] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.427890] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e3dd29-d25c-42d8-8457-59dc0e66f683',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.444927] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1011.445208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.445445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.445613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.445815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.445931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.445998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.446169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.446278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.446355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.446415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.508783] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.509114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.509114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.509495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.509495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.512851] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.528867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1011.595349] env[66919]: INFO networking_nsxv3.common.synchronization [None req-100380c2-a203-4858-b9b7-0aa78a85885a None None] Enqueued Resource ID: 9604e562-78be-4a3e-9de6-ace1ec4bea7d with Priority: HIGHEST for action port [ 1011.595915] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9604e562-78be-4a3e-9de6-ace1ec4bea7d with Priority: HIGHEST for action port [ 1011.596483] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9604e562-78be-4a3e-9de6-ace1ec4bea7d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.596637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9604e562-78be-4a3e-9de6-ace1ec4bea7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.596799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9604e562-78be-4a3e-9de6-ace1ec4bea7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.597173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9604e562-78be-4a3e-9de6-ace1ec4bea7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.597386] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9604e562-78be-4a3e-9de6-ace1ec4bea7d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.930306] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.930571] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.930644] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.930924] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.931089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.931246] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port c2e3dd29-d25c-42d8-8457-59dc0e66f683 not found, creating... [ 1011.931557] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.931754] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.931859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.932296] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.932457] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.932804] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.932962] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.933139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.933389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.933531] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.933671] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: c2e3dd29-d25c-42d8-8457-59dc0e66f683 is going to be created. [ 1011.948749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.948977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.949098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.949245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.949437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.949538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.949611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.949764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.949864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.949960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.950245] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.950245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.950363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.950450] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.950561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.950666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.950750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.950882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.950971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.951072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.951175] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.956085] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.956399] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.956599] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.956944] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.957165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.957401] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.015797] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.016194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.016322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.016597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.016706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.016820] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be created. [ 1012.049655] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.049837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.049905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.050159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.050318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.063786] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: UNINITIALIZED for 2s [ 1012.100019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9604e562-78be-4a3e-9de6-ace1ec4bea7d [ 1012.100274] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.100425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.100506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.100711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.100801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.100924] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9604e562-78be-4a3e-9de6-ace1ec4bea7d already deleted. [ 1012.101032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9604e562-78be-4a3e-9de6-ace1ec4bea7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.458028] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 1012.481537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.481834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.481955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.482216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.482386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.482692] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.482862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.483057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.483246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.483334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.483555] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.483650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.483729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.483879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.484241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.484329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.484387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.484668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.484708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.484847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1012.550136] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.550532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.550532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.550697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.550912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.568418] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1012.608392] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 in Status: SUCCESS [ 1012.609116] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5 deletion is rescheduled due to dependency. [ 1012.609116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.696850] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-9f25e615-d181-413c-9432-5008406a744a service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1012.696850] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-9f25e615-d181-413c-9432-5008406a744a service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1012.697094] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-9f25e615-d181-413c-9432-5008406a744a service nova] Enqueued Resource ID: c2e3dd29-d25c-42d8-8457-59dc0e66f683 with Priority: HIGHEST for action port [ 1012.697780] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1012.697914] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1012.704385] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2e3dd29-d25c-42d8-8457-59dc0e66f683 with Priority: HIGHEST for action port [ 1012.704385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.704385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.704385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.704385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.704385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2e3dd29-d25c-42d8-8457-59dc0e66f683 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.704385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.704385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.704385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.704385] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2e3dd29-d25c-42d8-8457-59dc0e66f683',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.208137] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2e3dd29-d25c-42d8-8457-59dc0e66f683 with status ACTIVE [ 1013.208137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.208137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.208137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.208137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.208476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209342] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.209342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.209342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209661] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.209661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.209661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.209847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.209847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.209847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2e3dd29-d25c-42d8-8457-59dc0e66f683 is going to be updated. [ 1013.250680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.250847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.250847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.251026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.251172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.251352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2e3dd29-d25c-42d8-8457-59dc0e66f683" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.548501] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1013.548501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.613543] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-776 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.613848] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.614308] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.614308] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.615531] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.615531] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.615678] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.616078] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.616078] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.616361] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.616549] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.616713] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.616867] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.617049] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.617219] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.617393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.643560] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.643681] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.643824] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.644922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-776" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.644922] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-27f79780-a597-41c2-9a67-fea94e16cdf4 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.644922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.644922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.645453] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.645453] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f79780-a597-41c2-9a67-fea94e16cdf4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.077644] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1014.077951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.078189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.078459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.078629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.078763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.078816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.079013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.079132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.079359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.079359] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.081078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.081266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.081448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.082032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.082032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.082032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.082032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.082032] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.148314] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.148488] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.148608] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.148904] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.149086] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.149253] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 27f79780-a597-41c2-9a67-fea94e16cdf4 not found, creating... [ 1014.149512] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.149665] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.149780] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.150019] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.150187] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.150489] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.150641] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.150891] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.150953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.151959] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.152131] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 27f79780-a597-41c2-9a67-fea94e16cdf4 is going to be created. [ 1014.180121] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.180651] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.180651] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.180923] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.181156] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.181415] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.581444] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.581695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.584836] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.606490] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1014.606770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.903011] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-b96bc0b8-05a4-41ae-8ddb-c862b2d3113c service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1014.903302] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-b96bc0b8-05a4-41ae-8ddb-c862b2d3113c service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1014.903389] env[66919]: INFO networking_nsxv3.common.synchronization [req-86b3a6ad-1048-4fc5-971e-f6ab6896718b req-b96bc0b8-05a4-41ae-8ddb-c862b2d3113c service nova] Enqueued Resource ID: 27f79780-a597-41c2-9a67-fea94e16cdf4 with Priority: HIGHEST for action port [ 1014.904120] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1014.904257] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1014.904396] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27f79780-a597-41c2-9a67-fea94e16cdf4 with Priority: HIGHEST for action port [ 1014.904730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.904855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.905219] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.905273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.905496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-27f79780-a597-41c2-9a67-fea94e16cdf4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.905653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.905769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.906097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.906262] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27f79780-a597-41c2-9a67-fea94e16cdf4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.089446] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.410401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27f79780-a597-41c2-9a67-fea94e16cdf4 with status ACTIVE [ 1015.410652] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.410795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.410853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.411115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.411210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.411402] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.411506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.411623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.411725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.411828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.412047] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.412147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.412206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.412349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.412422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.412505] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27f79780-a597-41c2-9a67-fea94e16cdf4 is going to be updated. [ 1015.437174] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.437338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.437386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.437594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.437730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.437915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27f79780-a597-41c2-9a67-fea94e16cdf4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.591936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.591936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.591936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.592154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.592154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.592216] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1015.626701] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.626865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.626906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.628502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.628502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.641235] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1016.378713] env[66919]: INFO networking_nsxv3.common.synchronization [None req-592217aa-e766-457f-94f1-1fb1b718e06f None None] Enqueued Resource ID: 332a21dd-4c6c-4723-8a21-11d415651385 with Priority: HIGHEST for action port [ 1016.379032] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 332a21dd-4c6c-4723-8a21-11d415651385 with Priority: HIGHEST for action port [ 1016.379647] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-332a21dd-4c6c-4723-8a21-11d415651385 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.379770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-332a21dd-4c6c-4723-8a21-11d415651385" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.379834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-332a21dd-4c6c-4723-8a21-11d415651385" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.383892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-332a21dd-4c6c-4723-8a21-11d415651385" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.383892] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('332a21dd-4c6c-4723-8a21-11d415651385',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.885745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 332a21dd-4c6c-4723-8a21-11d415651385 [ 1016.886026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.886192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.886287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.886596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.886719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.886844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:332a21dd-4c6c-4723-8a21-11d415651385 already deleted. [ 1016.886955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-332a21dd-4c6c-4723-8a21-11d415651385" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.654310] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1017.654693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.654693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.654934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.655145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.655263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.655318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.655475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.655757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.656438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.656652] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.656746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.657279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.657279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.657279] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.657279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.657279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.657566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.657566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.657566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.657661] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.658553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.658991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.658991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.658991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.659558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.659714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.659794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.659884] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.162451] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1018.163290] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.182592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.182773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.182868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.183161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.183161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.183338] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.183432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.183494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.183646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.183720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.183943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.184069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.184123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.184244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.184319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.184491] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.184582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.184640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.184775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.184879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.185015] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be created. [ 1018.255121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.255351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.255351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.255571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.255738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.270091] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1018.669318] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.046794] env[66919]: INFO networking_nsxv3.common.synchronization [req-92aa5527-68b7-4b87-a77c-f731238ed646 req-186f4619-491b-4f0c-a576-1403d5a25208 tempest-ServerTagsTestJSON-2010331192 tempest-ServerTagsTestJSON-2010331192-project-member] Enqueued Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1019.046794] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1019.047856] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.048036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.048168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.048487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.048575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.048654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.048767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.048936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.048936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.048999] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.075140] env[66919]: INFO networking_nsxv3.common.synchronization [None req-a8203520-945c-4a36-a80c-7bc693d9f621 None None] Enqueued Resource ID: 42ca9ca7-a0eb-490e-873d-0d79c67a4106 with Priority: HIGHEST for action port [ 1019.075140] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ca9ca7-a0eb-490e-873d-0d79c67a4106 with Priority: HIGHEST for action port [ 1019.075140] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-42ca9ca7-a0eb-490e-873d-0d79c67a4106 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.075140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42ca9ca7-a0eb-490e-873d-0d79c67a4106" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.075140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42ca9ca7-a0eb-490e-873d-0d79c67a4106" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.075140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42ca9ca7-a0eb-490e-873d-0d79c67a4106" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.075140] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42ca9ca7-a0eb-490e-873d-0d79c67a4106',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.167153] env[66919]: INFO networking_nsxv3.common.synchronization [None req-73fbaa4f-912f-4d75-8711-3518c87e6f80 None None] Enqueued Resource ID: fae1d79a-1a83-4cca-b425-d904fe68b9ad with Priority: HIGHEST for action port [ 1019.167153] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fae1d79a-1a83-4cca-b425-d904fe68b9ad with Priority: HIGHEST for action port [ 1019.167849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fae1d79a-1a83-4cca-b425-d904fe68b9ad taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.168465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fae1d79a-1a83-4cca-b425-d904fe68b9ad" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.168780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fae1d79a-1a83-4cca-b425-d904fe68b9ad" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.169440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fae1d79a-1a83-4cca-b425-d904fe68b9ad" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.169651] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fae1d79a-1a83-4cca-b425-d904fe68b9ad',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.175624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.176074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.176310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.179378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.179378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.179378] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1019.210412] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.210412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.210412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.210832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.210832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.221999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1019.551552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.551759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.553173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.553509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.553509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.554231] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.554231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.554231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.554231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.554231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.554231] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 already deleted. [ 1019.554594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.578748] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42ca9ca7-a0eb-490e-873d-0d79c67a4106 [ 1019.578991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.579135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.579200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.579418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.579504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.579604] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42ca9ca7-a0eb-490e-873d-0d79c67a4106 already deleted. [ 1019.579682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42ca9ca7-a0eb-490e-873d-0d79c67a4106" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672903] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fae1d79a-1a83-4cca-b425-d904fe68b9ad [ 1019.673200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.673279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.673384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.673558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.673647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.673745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fae1d79a-1a83-4cca-b425-d904fe68b9ad already deleted. [ 1019.673863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fae1d79a-1a83-4cca-b425-d904fe68b9ad" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.740975] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.740975] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.740975] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.740975] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.740975] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.742836] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.743031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.743285] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.743440] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.743663] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.743774] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.743911] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.744035] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.744150] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.744254] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.744412] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.764973] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.765128] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.765252] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.765516] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-46" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.766167] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-464ffa6a-c27f-42a5-89d1-8c1b710e8285 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.766319] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.766430] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.767776] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.767884] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464ffa6a-c27f-42a5-89d1-8c1b710e8285',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.275481] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.275481] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.275749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.275847] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.275935] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.276198] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 464ffa6a-c27f-42a5-89d1-8c1b710e8285 not found, creating... [ 1020.276464] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.276628] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.276744] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.276969] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.277116] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.277391] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.277547] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.277668] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.277953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.278105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.278252] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 is going to be created. [ 1020.283266] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1020.283339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.283504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.283690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.283774] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.313311] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.313489] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.313624] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.314158] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.315859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.316599] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.767322] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.767843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.767843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.768251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.768418] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.786547] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.787338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.006604] env[66919]: INFO networking_nsxv3.common.synchronization [req-92aa5527-68b7-4b87-a77c-f731238ed646 req-8ce6bc90-9286-4629-a5c7-bfbbf1e9dc52 service nova] Enqueued Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_rules [ 1021.007148] env[66919]: INFO networking_nsxv3.common.synchronization [req-92aa5527-68b7-4b87-a77c-f731238ed646 req-8ce6bc90-9286-4629-a5c7-bfbbf1e9dc52 service nova] Enqueued Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1021.007351] env[66919]: INFO networking_nsxv3.common.synchronization [req-92aa5527-68b7-4b87-a77c-f731238ed646 req-8ce6bc90-9286-4629-a5c7-bfbbf1e9dc52 service nova] Enqueued Resource ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with Priority: HIGHEST for action port [ 1021.007966] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_rules [ 1021.008131] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1021.008266] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with Priority: HIGHEST for action port [ 1021.008563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.008722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.008814] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.009119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.009538] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.011767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.015397] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.015397] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.015397] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-464ffa6a-c27f-42a5-89d1-8c1b710e8285 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.015397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.015978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.015978] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464ffa6a-c27f-42a5-89d1-8c1b710e8285',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.149175] env[66919]: INFO networking_nsxv3.common.synchronization [None req-8ba05ec0-6590-4e9f-bcb6-d13b3c12f463 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1021.149175] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1021.149175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.149522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.149559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.149855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.149934] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.234207] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1021.234950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.235177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.235395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.235608] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.235729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.235794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.235954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.236101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.236153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.236212] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.271083] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.423234] env[66919]: INFO networking_nsxv3.common.synchronization [None req-1a40568f-6f0c-490d-aa4c-b08361e31543 None None] Enqueued Resource ID: 4f897fe2-314e-4ce4-9e32-d828f9a030e5 with Priority: HIGHEST for action port [ 1021.423234] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f897fe2-314e-4ce4-9e32-d828f9a030e5 with Priority: HIGHEST for action port [ 1021.423234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f897fe2-314e-4ce4-9e32-d828f9a030e5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.423234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f897fe2-314e-4ce4-9e32-d828f9a030e5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.423234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f897fe2-314e-4ce4-9e32-d828f9a030e5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.423234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f897fe2-314e-4ce4-9e32-d828f9a030e5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.423870] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f897fe2-314e-4ce4-9e32-d828f9a030e5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.469462] env[66919]: INFO networking_nsxv3.common.synchronization [None req-b257e4b8-d14f-467c-8aab-02ba01307bf2 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1021.469462] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1021.469462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.469462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.512918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.512918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with status ACTIVE [ 1021.523032] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.523032] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.523032] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.523032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.523032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 is going to be updated. [ 1021.524824] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.553948] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.553948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.553948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.553948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.554268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.554268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.660479] env[66919]: INFO networking_nsxv3.common.synchronization [None req-00c7e4dc-b78c-43f3-83f8-917adfc29a70 None None] Enqueued Resource ID: e301ebec-f92d-45a4-8340-1c91cb2f1b7d with Priority: HIGHEST for action port [ 1021.662837] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e301ebec-f92d-45a4-8340-1c91cb2f1b7d with Priority: HIGHEST for action port [ 1021.663440] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e301ebec-f92d-45a4-8340-1c91cb2f1b7d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.663663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e301ebec-f92d-45a4-8340-1c91cb2f1b7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.663817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e301ebec-f92d-45a4-8340-1c91cb2f1b7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.664453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e301ebec-f92d-45a4-8340-1c91cb2f1b7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.664607] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e301ebec-f92d-45a4-8340-1c91cb2f1b7d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.715645] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.716673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.716673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.718023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.718023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.718023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 already deleted. [ 1021.718023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.718555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.718991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.719238] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.743441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.743441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.743441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.743441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.743441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.744120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.744120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.744120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.744120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.744120] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.774659] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.928192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4f897fe2-314e-4ce4-9e32-d828f9a030e5 [ 1021.928192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.928192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.928192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.928192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.928192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.928192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4f897fe2-314e-4ce4-9e32-d828f9a030e5 already deleted. [ 1021.928192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f897fe2-314e-4ce4-9e32-d828f9a030e5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.027334] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.168393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e301ebec-f92d-45a4-8340-1c91cb2f1b7d [ 1022.168627] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.168762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.168835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.169052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.169146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.169289] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e301ebec-f92d-45a4-8340-1c91cb2f1b7d already deleted. [ 1022.169387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e301ebec-f92d-45a4-8340-1c91cb2f1b7d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.240984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.240984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.240984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.240984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.240984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.241351] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 already deleted. [ 1022.241351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.246639] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1022.266765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.266765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.266765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.266765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.266765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.267065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.267122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.267177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.267871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.267871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.267871] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.267871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.267871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.267871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.268172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.268889] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.270032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.270032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.270032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.270032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.270205] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1022.276185] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1022.277786] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1022.350690] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.350922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.351805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.351805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.351805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.369607] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1022.528988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.529171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.529241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.529457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.529546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.530329] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 is going to be created. [ 1022.560039] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.560039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.560039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.560039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.560039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.570799] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: UNINITIALIZED for 2s [ 1022.935155] env[66919]: INFO networking_nsxv3.common.synchronization [req-c11b3dab-7e7c-432d-b0b7-71266d17baea req-3d1c0cae-c048-47e2-8d5c-189d2ec578df tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1022.935810] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1022.936593] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.936728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.936834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.937114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.937537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.937767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.937920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.938132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.938306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.938631] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.333980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.334254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.334254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.334433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.352526] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1023.353329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.354685] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1023.392037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.392037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.392037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.392267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.403929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.406112] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 1023.406243] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'464ffa6a-c27f-42a5-89d1-8c1b710e8285'} {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1023.406302] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1023.447122] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.453976] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.453976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.453976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.453976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.454672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.458023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1023.545031] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.545031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.545031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.545478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.546348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.546348] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1023.652642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.652818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.652992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.653394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.653829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.655258] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:39. [ 1023.655363] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'482283b1-d8c6-448e-bbe8-ed71e10e6b6b', '7116cbb7-b94d-4c76-af52-903722820ea6', '9691f7e5-d5a3-4f2d-86cc-9f1494cee046', '4b46dc5c-dcd7-49a6-a2b6-31024aac0805', 'a87b0710-8423-4a57-8221-4ad054db58d7', 'e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333', '5c800be9-5a1f-4e7d-acfb-e24947683dc0', '5116cc0e-6bd6-420e-8fb5-142b35508ce3', 'b86545e3-6fe4-40a0-b7a2-11e0ad14bf96', 'b0b1967b-4591-4210-b122-446732ce3041', '12f69e0f-ba18-45e6-aa72-789adc7ed5ed', '54a8eb66-4aa1-440c-af86-e5e65121f69f', '31932c99-4ae5-4683-9701-736f699e8f83', '6f1467a0-dd7b-4e6d-b03a-fc9a8001a008', '79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb', '760a77bb-57f0-44e3-b609-b74fb3c191fd', '2fc0f601-8257-4527-8366-40ea56f5ccdd', '6a8087ec-9851-40d6-a912-030b8d9ac9db', '068fbd14-1f23-4a8c-9eb8-6b8df298f30d', '2d1de849-c2e6-46e2-a774-597b77be599b', 'f8993b03-159d-4cb8-a490-873c724e7d28', '349962c6-3abc-4bf7-9059-df3d43836eb4', 'da753667-590d-44b7-b73e-76baaab11b84', 'c38fec75-1824-4123-9a27-d70b3e15c2bc', '8de9ea36-57e3-4c37-a587-59d118b05d81', '55d7cafa-a304-4afc-9136-b32b28d8fdc3', '11de85e1-8fdb-4cd8-898c-db27313f960d', '2b279846-5f96-463a-ab8f-df707aa1a846', '25ae71be-f061-446d-96fb-cc2053e285fa', '126dbb86-4151-4c70-bb98-79a6ebd8d9c5', 'edb06d74-09ba-41c3-8b40-ff12c2672902', '1c70302e-70ac-434d-a62c-6cde4cb391fa', '872d14cf-31fb-44ed-a275-fe8a6bdf8512', '82828762-4a66-4fd4-8d16-f6ddfbc9eb01', '07ef1b9b-e982-41f7-a4f6-a3caf8809311', 'dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5', 'af639ee4-0cf3-4378-b556-ae5617090112', '63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a', 'd72e45fa-d666-4664-a812-3413fb67c0b4'} {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1023.655470] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1023.678506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.678506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.678506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.678506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.678506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.678506] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1023.678506] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1023.678506] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1023.700382] env[66919]: INFO networking_nsxv3.common.synchronization [None req-73a543a7-bb5f-418d-aacf-f96977470789 None None] Enqueued Resource ID: 0168fda7-9910-4fa2-8f1d-d166aeb05527 with Priority: HIGHEST for action port [ 1023.700382] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0168fda7-9910-4fa2-8f1d-d166aeb05527 with Priority: HIGHEST for action port [ 1023.700912] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0168fda7-9910-4fa2-8f1d-d166aeb05527 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.701220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0168fda7-9910-4fa2-8f1d-d166aeb05527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.701220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0168fda7-9910-4fa2-8f1d-d166aeb05527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.701292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0168fda7-9910-4fa2-8f1d-d166aeb05527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.701359] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0168fda7-9910-4fa2-8f1d-d166aeb05527',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.754188] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.754367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.754417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.754608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.756670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.756670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1023.756670] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1023.756670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1023.756670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 1023.756670] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with Priority: HIGH for action port [ 1023.756670] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/39 resources of Type:Security Group Rules [ 1023.756670] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGH for action security_group_rules [ 1023.756670] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1023.756670] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGH for action security_group_rules [ 1023.756670] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGH for action security_group_rules [ 1023.757239] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGH for action security_group_rules [ 1023.757540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGH for action security_group_rules [ 1023.757879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.793180] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c0d69ff-20dc-42fd-9b21-e746b691d2ab req-0bc737c3-72b9-4504-bbe5-4a1bda662f80 tempest-ServerActionsV293TestJSON-87740859 tempest-ServerActionsV293TestJSON-87740859-project-member] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1023.793978] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1023.794493] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with Priority: HIGH for action port [ 1023.794629] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1023.794961] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGH for action security_group_rules [ 1023.794961] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 with Priority: HIGH for action security_group_rules [ 1023.795057] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d with Priority: HIGH for action security_group_rules [ 1023.795198] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db with Priority: HIGH for action security_group_rules [ 1023.795343] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd with Priority: HIGH for action security_group_rules [ 1023.795798] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd with Priority: HIGH for action security_group_rules [ 1023.795898] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31932c99-4ae5-4683-9701-736f699e8f83 with Priority: HIGH for action security_group_rules [ 1023.796024] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb with Priority: HIGH for action security_group_rules [ 1023.796152] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f with Priority: HIGH for action security_group_rules [ 1023.796841] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGH for action security_group_rules [ 1023.796841] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 1023.796841] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGH for action security_group_rules [ 1023.797090] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 with Priority: HIGH for action security_group_rules [ 1023.797090] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGH for action security_group_rules [ 1023.797184] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 with Priority: HIGH for action security_group_rules [ 1023.797325] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGH for action security_group_rules [ 1023.797383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGH for action security_group_rules [ 1023.797437] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGH for action security_group_rules [ 1023.797758] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.797887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.797953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.798323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.799065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.799167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.799245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.799460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.799704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.799704] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.800653] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-464ffa6a-c27f-42a5-89d1-8c1b710e8285 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.800782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.800856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.801068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.801163] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('464ffa6a-c27f-42a5-89d1-8c1b710e8285',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.802203] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.802321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.802725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.802906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.802992] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.803896] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.804152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.804224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.804384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.804532] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.807530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.807530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.807530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.808032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.808032] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6f1467a0-dd7b-4e6d-b03a-fc9a8001a008',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.809483] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.809483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.809483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.809483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.809483] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('068fbd14-1f23-4a8c-9eb8-6b8df298f30d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.809772] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a8087ec-9851-40d6-a912-030b8d9ac9db taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.809906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.809906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.810093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.810174] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a8087ec-9851-40d6-a912-030b8d9ac9db',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.810991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fc0f601-8257-4527-8366-40ea56f5ccdd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.811157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.811233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.811409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.811494] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fc0f601-8257-4527-8366-40ea56f5ccdd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.812780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-760a77bb-57f0-44e3-b609-b74fb3c191fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.812886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.812982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.813128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.813171] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('760a77bb-57f0-44e3-b609-b74fb3c191fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.814448] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-31932c99-4ae5-4683-9701-736f699e8f83 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.814448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.814448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.814448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.814448] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('31932c99-4ae5-4683-9701-736f699e8f83',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.815475] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.815764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.815764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.815851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.815902] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.816614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-54a8eb66-4aa1-440c-af86-e5e65121f69f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.816733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.817411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.817411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.817411] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('54a8eb66-4aa1-440c-af86-e5e65121f69f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.818407] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.818517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.818584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.819035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.819116] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.820128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.820238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.820303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.820459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.820523] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.821200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.821282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.821471] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.821569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.821630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.821817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.821902] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5116cc0e-6bd6-420e-8fb5-142b35508ce3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.823062] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.823193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.823260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.823410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.823477] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.824183] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.824277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.824339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.824485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.824555] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c800be9-5a1f-4e7d-acfb-e24947683dc0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.825296] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.825427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.825475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.825606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.825673] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.827159] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.827159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.827159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.827159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.827159] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.827658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.827769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.827828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.827980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.828064] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.949793] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.053701] env[66919]: INFO networking_nsxv3.common.synchronization [None req-6f7ee072-5ad0-4f7f-ac11-0eb095e565b9 tempest-ServersTestJSON-76893119 tempest-ServersTestJSON-76893119-project-member] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1024.054332] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1024.054644] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.054786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.054836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.055764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.055764] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.139379] env[66919]: INFO networking_nsxv3.common.synchronization [None req-f06ef2df-de06-4ff8-978e-02b090964df1 None None] Enqueued Resource ID: 7bdc0c8a-9e40-4200-8907-a1b8e408a7bf with Priority: HIGHEST for action port [ 1024.139958] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7bdc0c8a-9e40-4200-8907-a1b8e408a7bf with Priority: HIGHEST for action port [ 1024.140275] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7bdc0c8a-9e40-4200-8907-a1b8e408a7bf taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.140397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7bdc0c8a-9e40-4200-8907-a1b8e408a7bf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.140465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7bdc0c8a-9e40-4200-8907-a1b8e408a7bf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.140723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7bdc0c8a-9e40-4200-8907-a1b8e408a7bf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.140807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7bdc0c8a-9e40-4200-8907-a1b8e408a7bf',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.203273] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0168fda7-9910-4fa2-8f1d-d166aeb05527 [ 1024.203380] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.203545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.203648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.203912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.204014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.204113] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0168fda7-9910-4fa2-8f1d-d166aeb05527 already deleted. [ 1024.204195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0168fda7-9910-4fa2-8f1d-d166aeb05527" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.240872] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.240872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-603" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.240872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-603" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.240872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-603" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.240872] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.242542] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.244037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.244037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.244037] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.244037] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.244037] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1024.244037] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1024.244037] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1024.244351] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1024.244351] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1024.244351] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1024.248962] env[66919]: INFO networking_nsxv3.common.synchronization [None req-79a9bea0-1108-4b2c-9b9f-a6fc715bb9ca tempest-ServersTestJSON-76893119 tempest-ServersTestJSON-76893119-project-member] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1024.250636] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1024.250636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.250636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.269322] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1024.270393] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1024.270393] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1024.270393] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-603" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.270393] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-b090bbe7-935d-4cae-a284-4e6f3b0ea821 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.270393] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.270393] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.270703] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.270839] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b090bbe7-935d-4cae-a284-4e6f3b0ea821',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.330021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.330237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.330349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.330643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.330772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.331088] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.331211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.331314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.331525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.331667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.331751] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 already deleted. [ 1024.331838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.336913] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 464ffa6a-c27f-42a5-89d1-8c1b710e8285 with status ACTIVE [ 1024.337213] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.337342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.337425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.338243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.338243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.338243] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.338486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.338523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.339051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.339205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.339416] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.339518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.339594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.339769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.339852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.339976] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 464ffa6a-c27f-42a5-89d1-8c1b710e8285 is going to be updated. [ 1024.341995] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.342137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.342205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.342402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.342567] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.342704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.342795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.343027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.343146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.343412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.343412] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.348673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.348909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.348909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.349331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.349394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.349535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.349661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.349770] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.352918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.353046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.353119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.353286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.353508] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.353607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.353657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.353830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.353910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.353992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.354090] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.356051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.356172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.356272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.356506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.356649] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.356747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.356840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.356998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.357102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.357188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.357271] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.359958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.360492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.360592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.360731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.360881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.360978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.361053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.361193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.361272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.361441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.361441] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.364974] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.365109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.365153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.365424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.365476] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.365528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.365593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.365728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.365808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.365888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.365968] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.369868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.369982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.370080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.370250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.370409] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.370533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.370631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.370723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.370764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.370841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.370923] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.413042] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.413042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.413042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.413042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.417507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.417789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.418630] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.418731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.420687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.420687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.421204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.422392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.422721] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1024.423560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.423560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.423790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.423790] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.425580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.425580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.432710] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.432836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.433822] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.433945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.434618] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.434851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.436152] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.436152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.441020] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1024.441466] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.441630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.441718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.441946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.442090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.442262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-464ffa6a-c27f-42a5-89d1-8c1b710e8285" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.443082] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1024.443491] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.443587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.444249] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1024.444626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.444748] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6f1467a0-dd7b-4e6d-b03a-fc9a8001a008 is going to be deleted. [ 1024.448030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.448030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.451673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.451673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.451842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.451921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.452023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.452133] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1024.466341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.466501] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be deleted. [ 1024.468255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.468255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.487573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.487737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.487737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.488229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.488229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.490788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.490788] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5116cc0e-6bd6-420e-8fb5-142b35508ce3 is going to be deleted. [ 1024.491939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.492229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.506218] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1024.515653] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.515896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.524394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.525022] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 760a77bb-57f0-44e3-b609-b74fb3c191fd is going to be deleted. [ 1024.525874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.526189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.536855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.537104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.576855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.577042] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 31932c99-4ae5-4683-9701-736f699e8f83 is going to be deleted. [ 1024.578102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.578300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.583526] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: SUCCESS [ 1024.583804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.584016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.584333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.584616] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.584786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.584902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.585204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.585376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.585521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.585667] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.588053] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.588234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.634588] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.634588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.642695] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7bdc0c8a-9e40-4200-8907-a1b8e408a7bf [ 1024.643308] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.643308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.643308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.643502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.643537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.643631] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7bdc0c8a-9e40-4200-8907-a1b8e408a7bf already deleted. [ 1024.643757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7bdc0c8a-9e40-4200-8907-a1b8e408a7bf" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.646047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.646175] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 54a8eb66-4aa1-440c-af86-e5e65121f69f is going to be deleted. [ 1024.647116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.647332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.687106] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.687327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.695938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.696097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 068fbd14-1f23-4a8c-9eb8-6b8df298f30d is going to be deleted. [ 1024.697054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.697274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.698697] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.698885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.747920] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.747920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.772823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.772823] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb is going to be deleted. [ 1024.777099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.777348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.778655] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.778855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.779022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.779224] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.779368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.779515] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port b090bbe7-935d-4cae-a284-4e6f3b0ea821 not found, creating... [ 1024.779769] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.779927] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.780131] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.780295] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.780403] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781015] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.781015] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.781015] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.781268] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.781319] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.781427] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: b090bbe7-935d-4cae-a284-4e6f3b0ea821 is going to be created. [ 1024.840817] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.841052] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.841182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.841475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.841786] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.842056] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.844255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.844255] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fc0f601-8257-4527-8366-40ea56f5ccdd is going to be deleted. [ 1024.847732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.848034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.856267] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.872815] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.873937] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.874123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.874232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.874367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.874563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.874645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.874700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.875230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.875230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.875230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.875230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.875402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.875402] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.875465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.875573] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.875665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.875728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.875864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.875938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.876466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.876466] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.880800] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.882952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.882952] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.882952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.882952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.882952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.884120] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.884328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.884461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.884706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.884863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.884998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.885236] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.885380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.885475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.885699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.885908] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.886081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.886183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.886886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.887576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.887722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.887868] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.888888] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.890313] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.891095] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.908950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.909256] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c800be9-5a1f-4e7d-acfb-e24947683dc0 is going to be deleted. [ 1024.910481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.910766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.927227] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.927432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.927514] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.927723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.927915] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.928030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.928097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.928445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.928445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.928445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.928617] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.940820] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.941014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.956593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.956880] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a8087ec-9851-40d6-a912-030b8d9ac9db is going to be deleted. [ 1024.957893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.958151] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.958249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.958372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6f1467a0-dd7b-4e6d-b03a-fc9a8001a008" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.958749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.959512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.959604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.959726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.960538] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.962876] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 already deleted. [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5116cc0e-6bd6-420e-8fb5-142b35508ce3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.962876] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.962876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.964055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-760a77bb-57f0-44e3-b609-b74fb3c191fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-31932c99-4ae5-4683-9701-736f699e8f83" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-54a8eb66-4aa1-440c-af86-e5e65121f69f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.967305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.967683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.967843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.968179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-068fbd14-1f23-4a8c-9eb8-6b8df298f30d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.968468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.969505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.970662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.970662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79ad0fd5-41db-4f9b-9bbb-b3bcc28d69cb" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.035880] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.036643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.036643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.036643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.036643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.036643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fc0f601-8257-4527-8366-40ea56f5ccdd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.090763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.090763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.090763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.091121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.091176] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.091283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.091350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.091517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.091608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.091713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.091888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.091992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.092468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.092468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.092468] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.092468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.092616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.092649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.092733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.092783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.092917] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.098045] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.098045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.098045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.098198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.098198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.098371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c800be9-5a1f-4e7d-acfb-e24947683dc0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.110929] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.111154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.111154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.111735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.111735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.111735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a8087ec-9851-40d6-a912-030b8d9ac9db" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.361892] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b46dc5c-dcd7-49a6-a2b6-31024aac0805: rpc.has_security_group_logging(os_id): False [ 1025.383455] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a87b0710-8423-4a57-8221-4ad054db58d7: rpc.has_security_group_logging(os_id): False [ 1025.387674] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.387966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.388083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.388322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.394080] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333: rpc.has_security_group_logging(os_id): False [ 1025.399356] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9691f7e5-d5a3-4f2d-86cc-9f1494cee046: rpc.has_security_group_logging(os_id): False [ 1025.400361] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 12f69e0f-ba18-45e6-aa72-789adc7ed5ed: rpc.has_security_group_logging(os_id): False [ 1025.401276] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 1025.402149] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 1025.406491] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.406491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.410535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.410851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.410948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.411052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.411225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.411308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.411393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1025.412442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.412614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.423085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.423085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.423992] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.424112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.431665] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.431848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.431944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.432218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.432357] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.432592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.432592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.432725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.432797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.432938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.433248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.433248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.433248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.433373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.433958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.433958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.433958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.434404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.434404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.434404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.434404] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.436025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.436144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.437688] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.437688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.437688] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.437881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.441126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441403] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.441485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.441581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.441730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.441865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.441959] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 is going to be updated. [ 1025.444071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.444071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.470119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.470119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.470119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.470119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.470119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.470119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.470446] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.470446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.470446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.470571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.470735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.470991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.471056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.471125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.472130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.472130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.474620] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 1025.477128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.477340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.501531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.501775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.505424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.505424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.506422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.506606] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.506673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.506709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.507053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.507116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.507460] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.507586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.507586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.507757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.507982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.508114] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.508310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.508310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.508536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.508536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.508682] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1025.510044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.510204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.512229] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.512359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.534561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.535180] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.535180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.535180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.535442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.535442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.535597] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 is going to be updated. [ 1025.536546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.536725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.551671] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.552102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.569024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.569024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.569024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.569024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.569024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.569024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.569024] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1025.570144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.570694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.570992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.572300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.572909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.599536] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10f9800a-60de-419a-9c5b-281e9c36e6e6: rpc.has_security_group_logging(os_id): False [ 1025.632056] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c0d69ff-20dc-42fd-9b21-e746b691d2ab req-e8919ee3-1767-4d0f-8151-6fc49049dabe service nova] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 1025.632056] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c0d69ff-20dc-42fd-9b21-e746b691d2ab req-e8919ee3-1767-4d0f-8151-6fc49049dabe service nova] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1025.632056] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c0d69ff-20dc-42fd-9b21-e746b691d2ab req-e8919ee3-1767-4d0f-8151-6fc49049dabe service nova] Enqueued Resource ID: b090bbe7-935d-4cae-a284-4e6f3b0ea821 with Priority: HIGHEST for action port [ 1025.632969] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_rules [ 1025.635749] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1025.635749] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b090bbe7-935d-4cae-a284-4e6f3b0ea821 with Priority: HIGHEST for action port [ 1025.635749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.635749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.635749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.635749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.636352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.636827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.637167] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.640587] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.641112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.641890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.643024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.643024] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.643024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.643024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.643465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.643774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.644025] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.647341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b090bbe7-935d-4cae-a284-4e6f3b0ea821 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.647341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.647341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.647341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.647341] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b090bbe7-935d-4cae-a284-4e6f3b0ea821',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.650903] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1025.656464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.656464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.658989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.659360] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.659360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.659910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.660778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.660778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.660778] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed is going to be updated. [ 1025.662823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.662823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.662823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.662823] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 already deleted. [ 1025.662823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.662823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.663212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.663212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.666146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.666605] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.666764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.668276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.668611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.668611] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.671959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.672260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.672428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.672759] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.672926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.673144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.673420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.673544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.673865] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.674033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.674125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.674333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.674461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.678417] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.678417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.678417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.678417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.678417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.678417] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 is going to be created. [ 1025.692063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.692063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.692063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.692063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.692063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.702543] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: IN_PROGRESS for 2s [ 1025.703920] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 1025.704616] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1025.720157] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: IN_PROGRESS for 2s [ 1025.821988] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.822158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.822279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.822792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.822792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.842557] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.842557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.842557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.842557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.842557] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.854209] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.854368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.854448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.854672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.854848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.894880] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1025.895940] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: IN_PROGRESS for 2s [ 1025.896867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: IN_PROGRESS for 2s [ 1025.941299] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1025.987133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.987133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.987133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.987550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.025808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.026093] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.026269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.026329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.026573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.026660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.026882] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.026989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.027063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.027207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.027338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.027532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.027628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.027689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.027973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.027973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.027973] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1026.113341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.113528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.113638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.113921] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.114138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.137083] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1026.140766] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.141084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.149714] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b090bbe7-935d-4cae-a284-4e6f3b0ea821 with status ACTIVE [ 1026.149980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.150188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.150250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.150631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.150631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.150830] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.150830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.151118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.151375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.151461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.152457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.152457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.152457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.152457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.152457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.153625] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b090bbe7-935d-4cae-a284-4e6f3b0ea821 is going to be updated. [ 1026.154245] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.178759] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.178759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.178759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.178759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.178759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.178759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b090bbe7-935d-4cae-a284-4e6f3b0ea821" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.518804] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1026.519072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.657475] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.943734] env[66919]: INFO networking_nsxv3.common.synchronization [req-b8ab1801-2537-4b84-8e31-d118c455ff76 req-41c04f44-25c3-460e-98d0-91b7c5c1138e tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1026.944600] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1026.945812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.945812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.945812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.945812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.946535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.946535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.946535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.946535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.946535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.946845] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.162621] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.162999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.162999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.163100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.163180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.163290] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 is going to be created. [ 1027.190847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.190998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.191068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.191282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.191518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.201754] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: UNINITIALIZED for 2s [ 1027.442410] env[66919]: INFO networking_nsxv3.common.synchronization [None req-014afc55-97f6-44fe-bace-7b5ed973a349 None None] Enqueued Resource ID: 4328416e-56b8-4a81-aeef-a17862d074ce with Priority: HIGHEST for action port [ 1027.443116] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4328416e-56b8-4a81-aeef-a17862d074ce with Priority: HIGHEST for action port [ 1027.443456] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-4328416e-56b8-4a81-aeef-a17862d074ce taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.443639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4328416e-56b8-4a81-aeef-a17862d074ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.443762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4328416e-56b8-4a81-aeef-a17862d074ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.444032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4328416e-56b8-4a81-aeef-a17862d074ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.444115] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4328416e-56b8-4a81-aeef-a17862d074ce',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.448932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.449129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.449188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.449392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.475466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.475897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.476129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.476356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.476898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.476898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.476898] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1027.512943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.513236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.513362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.513658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.513915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.534128] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1027.664928] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1027.665244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.719088] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 1027.719325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.720089] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: SUCCESS [ 1027.720269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.721795] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1027.722021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.730878] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: SUCCESS [ 1027.731104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.914060] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: SUCCESS [ 1027.914719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.915171] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1027.915362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.916259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: SUCCESS [ 1027.916404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.947341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4328416e-56b8-4a81-aeef-a17862d074ce [ 1027.947611] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.947795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.947914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.948207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.948303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.948409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4328416e-56b8-4a81-aeef-a17862d074ce already deleted. [ 1027.948544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4328416e-56b8-4a81-aeef-a17862d074ce" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.152083] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1028.153364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.153573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.155179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.155179] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.658101] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.658101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.658615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.658615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.658615] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.658615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.658855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.658855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.658963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.659029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.659087] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.162041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.162206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.162305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.162517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.162730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.162838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.162902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.163087] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.163176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.163267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.163506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.163506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.163603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.163716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.163868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.163958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.164033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.164164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.164233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.164311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.164393] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.211271] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: UNINITIALIZED for 4s [ 1029.391197] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.391197] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.391197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.391197] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.391197] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.391197] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.391197] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.391959] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.391959] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.391959] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.414090] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.416272] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.416609] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.416903] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.417973] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.418261] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.418440] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.418827] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.419083] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c2a42c-a829-4365-85d0-f34d31f4cf7f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.548244] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1029.548472] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1029.548543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.666837] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1029.703785] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.703972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.704060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.704632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.704945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.705225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.705341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.705405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.705592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.705671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.705887] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.706259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.706338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.706497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.706554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.706736] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.706828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.706880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.707029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.707105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.707189] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1029.794968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.795123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.795178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.795375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.795516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.819446] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1029.928024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.928024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.928024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.928832] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.928832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.928832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.929750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.929750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.929750] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f is going to be updated. [ 1029.958109] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.958473] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.958689] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.959857] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.959857] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.960701] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.694887] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6c2718e-d75d-4e84-9048-db3b85bb87b3 req-a3f82822-9ca9-4f6a-83e9-e5d549efb6b1 service nova] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 1030.695247] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6c2718e-d75d-4e84-9048-db3b85bb87b3 req-a3f82822-9ca9-4f6a-83e9-e5d549efb6b1 service nova] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 1030.695247] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6c2718e-d75d-4e84-9048-db3b85bb87b3 req-a3f82822-9ca9-4f6a-83e9-e5d549efb6b1 service nova] Enqueued Resource ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f with Priority: HIGHEST for action port [ 1030.697018] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_rules [ 1030.697018] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 1030.697018] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f with Priority: HIGHEST for action port [ 1030.697385] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.697468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.697567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.698074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.698221] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.699788] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.699951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.700971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.700971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.700971] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.700971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.701270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.702476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.702476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.702476] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.703318] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.703555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.703617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.704407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.704537] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0c2a42c-a829-4365-85d0-f34d31f4cf7f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.876117] env[66919]: INFO networking_nsxv3.common.synchronization [req-a9916f10-e62e-41cb-83a3-387d46780611 req-57b0e4f4-1364-464b-9acb-35cfbf693f5e tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1030.876752] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1030.877084] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.877224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.877297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.877527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.878272] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.878401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.878474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.878879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.878879] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.878879] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.168193] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa3cec46-87fd-4caf-9612-6314a5c27240 req-a0aa9e19-6c66-459e-b7d5-df2e21ca92b4 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.168458] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.168791] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.168915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.169031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.169485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.169669] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.169779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.169843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.170043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.170367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.170615] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.206099] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.208515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.208515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.208865] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0c2a42c-a829-4365-85d0-f34d31f4cf7f with status ACTIVE [ 1031.209076] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.209076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.209203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.209320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.209389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.209569] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.209885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.209885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.209885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.210060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.210111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.210473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.210473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.210473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.210473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.210655] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0c2a42c-a829-4365-85d0-f34d31f4cf7f is going to be updated. [ 1031.230791] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: SUCCESS [ 1031.231070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.231770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.232123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.232562] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.232971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.234135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.234135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.234135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.234135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.234135] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.242260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.242260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.242260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.243190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.243190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.243190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0c2a42c-a829-4365-85d0-f34d31f4cf7f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.381297] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.381484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.381542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.381743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.381834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.382059] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.382170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.382247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.382401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.382480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.382571] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1031.416502] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.416502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.416502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.416675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.416807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.426309] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1031.455248] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa3cec46-87fd-4caf-9612-6314a5c27240 req-1ddc05f7-e1e9-4517-8020-384129ffd626 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.455248] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.455248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.455248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.674340] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.708265] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.736136] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.746724] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa3cec46-87fd-4caf-9612-6314a5c27240 req-cf8b6c8c-4ed6-486b-8dd5-f3e1b71ff118 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.746724] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1031.746937] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.746937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.835640] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1031.835964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.179115] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.210785] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.211245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.211245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.211245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.211245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.211456] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be updated. [ 1032.239750] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2fdb353a-0a88-42ad-98f8-50760f3a6798: rpc.has_security_group_logging(os_id): False [ 1032.261579] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.261579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.261782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.262120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.262316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.265375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.265447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.265541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.265926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.266675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.267200] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.267396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.267500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.267895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.267955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268329] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 is going to be created. [ 1032.285155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: IN_PROGRESS for 2s [ 1032.345805] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.346166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.346269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.346445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.346624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.359938] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: IN_PROGRESS for 2s [ 1032.684550] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.684550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.684550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.684550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.684550] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.684550] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1032.723260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.723692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.723692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.723930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.724080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.735586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1033.442475] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1033.442475] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 deletion is rescheduled due to dependency. [ 1033.442475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.296801] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: SUCCESS [ 1034.297147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.297352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.297608] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.297853] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.297982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.298077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.298272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.298601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.298601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.301722] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.373121] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: SUCCESS [ 1034.373380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.555543] env[66919]: INFO networking_nsxv3.common.synchronization [None req-525a74a5-d83c-483f-b3cb-a9eac19ce884 None None] Enqueued Resource ID: 460233f5-5379-4ff4-a021-2e4d611d96f2 with Priority: HIGHEST for action port [ 1034.556341] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 460233f5-5379-4ff4-a021-2e4d611d96f2 with Priority: HIGHEST for action port [ 1034.556812] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-460233f5-5379-4ff4-a021-2e4d611d96f2 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.557931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-460233f5-5379-4ff4-a021-2e4d611d96f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.558048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-460233f5-5379-4ff4-a021-2e4d611d96f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.558641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-460233f5-5379-4ff4-a021-2e4d611d96f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.558856] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('460233f5-5379-4ff4-a021-2e4d611d96f2',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.749322] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1034.749532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.749705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.749916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.751270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.751408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.751483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.751658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.752295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.752295] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.804526] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.064438] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 460233f5-5379-4ff4-a021-2e4d611d96f2 [ 1035.064759] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.064900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.064962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.065196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.065281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.065376] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:460233f5-5379-4ff4-a021-2e4d611d96f2 already deleted. [ 1035.065457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-460233f5-5379-4ff4-a021-2e4d611d96f2" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.261132] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.261132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.261132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.261132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.261132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.261525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.261525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.261525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.262971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.262971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.262971] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1035.276946] env[66919]: INFO networking_nsxv3.common.synchronization [None req-caccc390-ca7f-405e-9697-d428babfce04 tempest-ServersTestBootFromVolume-1784369835 tempest-ServersTestBootFromVolume-1784369835-project-member] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1035.277543] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1035.277946] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.278481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.278571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.278891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.281189] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.293833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.293833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.293833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.293833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.293833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.302847] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1035.307570] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 482283b1-d8c6-448e-bbe8-ed71e10e6b6b: rpc.has_security_group_logging(os_id): False [ 1035.327672] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.327672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.327672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.327672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.327962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.327962] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.328642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.328642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.328642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.328642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.328642] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be created. [ 1035.376826] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4643b2e0-3067-4df2-8beb-5f80c07edb0b tempest-ServersTestBootFromVolume-1784369835 tempest-ServersTestBootFromVolume-1784369835-project-member] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1035.376826] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1035.376826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.376969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.399219] env[66919]: INFO networking_nsxv3.common.synchronization [req-4e90388e-298a-4eb1-92ee-267c23e273f1 req-e41e5bcd-6be5-494b-b3e4-9a1d7d385f07 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1035.399895] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1035.400234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.400386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.400469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.400688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.400862] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.402547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.402640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.402864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.403008] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.403127] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.413128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.413390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.413390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.413587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.413866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.430516] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: IN_PROGRESS for 2s [ 1035.818741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.818895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.818967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.819213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.819304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.819400] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e already deleted. [ 1035.819483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.819644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.820075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.820166] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.909704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.909961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.910040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.910270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.910364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.910590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.910729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.910792] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.910935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.911046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.911147] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1035.956905] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.957187] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.957301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.957551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.958516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.984280] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1036.345089] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.345371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.345371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.345561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.345672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.345766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e already deleted. [ 1036.345885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.099182] env[66919]: INFO networking_nsxv3.common.synchronization [req-5970ce83-3573-469d-be80-e9cdaf02f2ce req-18127f48-b1f6-4587-a7b2-27162a36cd6a tempest-ServerTagsTestJSON-2010331192 tempest-ServerTagsTestJSON-2010331192-project-member] Enqueued Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1037.099706] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGHEST for action security_group_members [ 1037.100014] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.100272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.102121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.102121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.102121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.102121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.102121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.102377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.102377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.102377] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.222311] env[66919]: INFO networking_nsxv3.common.synchronization [None req-50b7c77c-0436-4301-a754-547fa21e8e63 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1037.223100] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1037.223930] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.224076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.224139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.224449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.224558] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.315645] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1037.315840] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 deletion is rescheduled due to dependency. [ 1037.315983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.316169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.316378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.316602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.316774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.316863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.319016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.319016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.319016] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.382096] env[66919]: INFO networking_nsxv3.common.synchronization [None req-60e86e31-63f9-4cd0-ba9c-6b6d8b290984 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1037.383625] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1037.384175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.384314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.389980] env[66919]: INFO networking_nsxv3.common.synchronization [req-dea93b73-ba44-4a4a-b60b-ad574f680a41 req-66de3f70-3c07-4abe-b0e8-7b6f5fee947c tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1037.390740] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1037.392130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.392130] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.392130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.392130] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.444541] env[66919]: INFO networking_nsxv3.common.synchronization [None req-62847c34-3af4-47f0-8744-33b249265a3a None None] Enqueued Resource ID: 33a50320-6ce7-455b-9c9e-f91951be2652 with Priority: HIGHEST for action port [ 1037.444945] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33a50320-6ce7-455b-9c9e-f91951be2652 with Priority: HIGHEST for action port [ 1037.445477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-33a50320-6ce7-455b-9c9e-f91951be2652 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.445477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33a50320-6ce7-455b-9c9e-f91951be2652" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.445716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33a50320-6ce7-455b-9c9e-f91951be2652" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.446436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33a50320-6ce7-455b-9c9e-f91951be2652" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.446436] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33a50320-6ce7-455b-9c9e-f91951be2652',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.448768] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: SUCCESS [ 1037.449085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.608658] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.608912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.608912] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.609137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.609224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.609433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.609541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.609594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.609783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.609863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.609943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 is going to be updated. [ 1037.642076] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.642245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.642245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.642427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.642567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.652429] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: IN_PROGRESS for 2s [ 1037.748029] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.748188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.748240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.748474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.748601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.748732] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c already deleted. [ 1037.749037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.749250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.749463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.749592] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.821210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.821210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.821396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.821487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.821616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.821957] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.822094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.822170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.822441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.822531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.822651] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1037.854965] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.856040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.856040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.856040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.856040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.866948] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1037.894761] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.950873] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33a50320-6ce7-455b-9c9e-f91951be2652 [ 1037.951134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.951666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.951666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.951898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.952177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.952177] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33a50320-6ce7-455b-9c9e-f91951be2652 already deleted. [ 1037.952177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33a50320-6ce7-455b-9c9e-f91951be2652" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.997551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1037.997725] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 1037.997837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.184699] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b0d5447-0774-45d9-a459-60216fe6d85d req-26dd44d1-3c6b-41a2-b559-473d49ed6d2b tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1038.185211] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1038.185525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.185635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.185714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.186239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.186239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.186239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.186495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.186495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.186624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.186624] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.286897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.287153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.287256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.287566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.287724] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.287878] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c already deleted. [ 1038.287991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.397208] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.594697] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.594959] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.595631] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.597407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.598361] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.598361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.598361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.598361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.598361] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.598751] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.598751] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.598822] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.598886] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.598994] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.599115] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.599247] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.625359] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.625617] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.625806] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.626043] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.626365] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-9cd0e49b-7776-4e12-b825-32f5c087e708 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.626537] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.626658] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.627052] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.627208] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd0e49b-7776-4e12-b825-32f5c087e708',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.688712] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.688895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.688974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.689221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.689310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.690498] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.690498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.690498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.690498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.690498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.690498] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 already deleted. [ 1038.690498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.902404] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.902707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.902707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.902827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.902918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.903027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1038.933308] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.933604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.933604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.933765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.933916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.948291] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1039.129925] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.130768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.130768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.130768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.130768] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.131157] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 9cd0e49b-7776-4e12-b825-32f5c087e708 not found, creating... [ 1039.131195] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.131358] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.131490] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.131715] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.131854] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.132232] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.132366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.132906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.132906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.132906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.133109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 9cd0e49b-7776-4e12-b825-32f5c087e708 is going to be created. [ 1039.161933] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.163318] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.163650] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.164074] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.164389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.164723] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.667115] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 in Status: SUCCESS [ 1039.667401] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 deletion is rescheduled due to dependency. [ 1039.667458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.884723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1039.884983] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 deletion is rescheduled due to dependency. [ 1039.885700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.932268] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b0d5447-0774-45d9-a459-60216fe6d85d req-c95629b7-a981-4b04-ae2a-f2b3ae382da3 service nova] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1039.932950] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b0d5447-0774-45d9-a459-60216fe6d85d req-c95629b7-a981-4b04-ae2a-f2b3ae382da3 service nova] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1039.933320] env[66919]: INFO networking_nsxv3.common.synchronization [req-5b0d5447-0774-45d9-a459-60216fe6d85d req-c95629b7-a981-4b04-ae2a-f2b3ae382da3 service nova] Enqueued Resource ID: 9cd0e49b-7776-4e12-b825-32f5c087e708 with Priority: HIGHEST for action port [ 1039.935846] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1039.936159] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1039.936456] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cd0e49b-7776-4e12-b825-32f5c087e708 with Priority: HIGHEST for action port [ 1039.936969] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.937331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.937512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.937780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.937879] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.943274] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.943463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.943635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.944283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.944283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.944283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.944456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.944727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.944804] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.944904] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.946018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cd0e49b-7776-4e12-b825-32f5c087e708 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.946223] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.946291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.946533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.946712] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cd0e49b-7776-4e12-b825-32f5c087e708',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.450382] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.450382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.450648] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.451568] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cd0e49b-7776-4e12-b825-32f5c087e708 with status ACTIVE [ 1040.451771] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.451892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.451947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.452173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.452264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.452808] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.452808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.452808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.452808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.454239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.454239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.454239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.454239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.454239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.454239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.454239] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cd0e49b-7776-4e12-b825-32f5c087e708 is going to be updated. [ 1040.480813] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.481311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.481311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.481562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.481768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.482123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cd0e49b-7776-4e12-b825-32f5c087e708" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.659534] env[66919]: INFO networking_nsxv3.common.synchronization [req-b8d74c0c-5d61-41c2-b49a-0488fa021427 req-2a0cbb63-c28d-4256-8ff2-c2345eed420f tempest-VolumesAdminNegativeTest-1221304702 tempest-VolumesAdminNegativeTest-1221304702-project-member] Enqueued Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1040.660598] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1040.660598] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.660598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.660598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.660878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.660968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.661340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.661488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.661654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.661784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.661925] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.956461] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.963363] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1040.963363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.983217] env[66919]: INFO networking_nsxv3.common.synchronization [req-60392dd6-5c33-44d2-b32f-f7a5007e8b47 req-75f26b44-d638-4746-a5ca-65360ddd4787 tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 1040.984391] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGHEST for action security_group_members [ 1040.984391] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.984391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.984680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.984680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.984784] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.984910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.984980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.985166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.985166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.985314] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.068790] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-349 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.069170] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.069352] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.069660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.069961] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.070182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.070330] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.070577] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.070753] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.070989] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.071146] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.071296] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.071761] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.071761] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.071761] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.071921] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.099070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.099324] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.099438] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.099584] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-349" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.099907] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-f205b037-3d2c-4599-b3c9-d1dcff896286 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.100150] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.100193] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.100631] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.100777] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f205b037-3d2c-4599-b3c9-d1dcff896286',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.165184] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.165184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.165184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.165184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.166978] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.166978] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 already deleted. [ 1041.166978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.458868] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.459150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.459260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.459525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.459651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.459781] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be created. [ 1041.490736] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.490924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.490975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.491197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.491353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.492687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.492843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.492919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.495987] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.496143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.496452] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.496547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.496547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.496778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.496888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.497014] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed is going to be updated. [ 1041.513185] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: UNINITIALIZED for 2s [ 1041.530622] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.530835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.530835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.531430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.531596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.541849] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: IN_PROGRESS for 2s [ 1041.603401] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.603709] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.603848] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.604157] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.604308] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.604490] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port f205b037-3d2c-4599-b3c9-d1dcff896286 not found, creating... [ 1041.605132] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.605132] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.605132] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.605610] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.605610] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.605791] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.605971] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.606109] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.606345] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.606449] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.606587] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: f205b037-3d2c-4599-b3c9-d1dcff896286 is going to be created. [ 1041.638477] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.638737] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.638866] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.639230] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.639476] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.639708] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [req-b8d74c0c-5d61-41c2-b49a-0488fa021427 req-3d4cae0f-1de9-412e-8c9d-24dbbf9e1cb7 service nova] Enqueued Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_rules [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [req-b8d74c0c-5d61-41c2-b49a-0488fa021427 req-3d4cae0f-1de9-412e-8c9d-24dbbf9e1cb7 service nova] Enqueued Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [req-b8d74c0c-5d61-41c2-b49a-0488fa021427 req-3d4cae0f-1de9-412e-8c9d-24dbbf9e1cb7 service nova] Enqueued Resource ID: f205b037-3d2c-4599-b3c9-d1dcff896286 with Priority: HIGHEST for action port [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_rules [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1042.382394] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f205b037-3d2c-4599-b3c9-d1dcff896286 with Priority: HIGHEST for action port [ 1042.382394] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.382394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.382394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.382394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.382998] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.386596] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.386745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.386745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.386947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.387252] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.387359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.387411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.387569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.387650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.387743] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.389139] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f205b037-3d2c-4599-b3c9-d1dcff896286 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.389307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.389392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.389577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.389679] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f205b037-3d2c-4599-b3c9-d1dcff896286',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.894869] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.894869] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.894869] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f205b037-3d2c-4599-b3c9-d1dcff896286 with status ACTIVE [ 1042.894869] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.894869] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.895315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.896669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.896669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.896907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.896979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.897100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.897166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.897330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.898684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.898684] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f205b037-3d2c-4599-b3c9-d1dcff896286 is going to be updated. [ 1042.925876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.925876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.925876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.925876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.926134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.926171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f205b037-3d2c-4599-b3c9-d1dcff896286" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.162784] env[66919]: INFO networking_nsxv3.common.synchronization [req-a1dcb95a-a6c4-4864-b4c2-fa55ca80859b req-1b82be89-df28-4bd6-bb98-d0fbfab273ae tempest-ServersTestJSON-76893119 tempest-ServersTestJSON-76893119-project-member] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1043.163410] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1043.163784] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.163911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.163969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.164642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.164642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.164833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.164833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.164959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.164959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.165249] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.401154] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.526248] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1043.526945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.527375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.528067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.528320] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.528521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.528602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.529066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.529066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.529066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.529688] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.534012] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-699 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.535195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-699" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.535195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-699" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.535195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-699" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.535195] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.535398] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.535435] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.535789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.535954] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.536612] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.536612] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.536612] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.536612] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.536778] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.536815] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.536949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.565259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed in Status: SUCCESS [ 1043.565496] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed deletion is rescheduled due to dependency. [ 1043.565573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.566895] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.567084] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.567184] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.567373] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-699" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.567686] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-8063168b-6be4-4045-abaf-9a4aba812e28 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.568023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.568144] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.569030] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.569030] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8063168b-6be4-4045-abaf-9a4aba812e28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.667717] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.667872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.667946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668488] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.668588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.668653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.668816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.668887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.668977] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 already deleted. [ 1043.669059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.903720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.903949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.904079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.904399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.904543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.904693] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 is going to be created. [ 1043.931417] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.931594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.931668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.931885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.932076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.942471] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: UNINITIALIZED for 2s [ 1044.032146] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.071487] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.071756] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.071890] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.072189] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.072339] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.072498] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 8063168b-6be4-4045-abaf-9a4aba812e28 not found, creating... [ 1044.072760] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.073555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.073555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.073555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.073555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.073742] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.073897] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.074161] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.074299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.074413] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.074547] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 8063168b-6be4-4045-abaf-9a4aba812e28 is going to be created. [ 1044.094102] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.094353] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.094513] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.094858] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.095143] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.095413] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.534421] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da45b7e6-efbe-4bfe-be25-61bfeb440e55: rpc.has_security_group_logging(os_id): False [ 1044.568367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.568616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.568616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.568859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.568982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.569313] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.569584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.569584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.569813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.569975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.570083] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be created. [ 1044.646510] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.646687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.646731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.646994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.647422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.663901] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1044.896142] env[66919]: INFO networking_nsxv3.common.synchronization [req-a1dcb95a-a6c4-4864-b4c2-fa55ca80859b req-9c50f49a-4a32-488b-8da7-c4967656a9af service nova] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1044.896322] env[66919]: INFO networking_nsxv3.common.synchronization [req-a1dcb95a-a6c4-4864-b4c2-fa55ca80859b req-9c50f49a-4a32-488b-8da7-c4967656a9af service nova] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1044.896557] env[66919]: INFO networking_nsxv3.common.synchronization [req-a1dcb95a-a6c4-4864-b4c2-fa55ca80859b req-9c50f49a-4a32-488b-8da7-c4967656a9af service nova] Enqueued Resource ID: 8063168b-6be4-4045-abaf-9a4aba812e28 with Priority: HIGHEST for action port [ 1044.899346] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_rules [ 1044.899783] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1044.899944] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8063168b-6be4-4045-abaf-9a4aba812e28 with Priority: HIGHEST for action port [ 1044.901557] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.901813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.901892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.902122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.902224] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.903728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.903907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.907685] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.907685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.908078] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.908952] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-8063168b-6be4-4045-abaf-9a4aba812e28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.909132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.909238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.909473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.909599] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8063168b-6be4-4045-abaf-9a4aba812e28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.419514] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.419662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.419864] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8063168b-6be4-4045-abaf-9a4aba812e28 with status ACTIVE [ 1045.420059] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.420210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.420305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.420535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.420631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.420807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.420911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.420972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.421143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.421222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.421409] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.421503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.421566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.421739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.421803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.421900] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8063168b-6be4-4045-abaf-9a4aba812e28 is going to be updated. [ 1045.423763] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.448547] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.448725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.448828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.449068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.449218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.449377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8063168b-6be4-4045-abaf-9a4aba812e28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.927417] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.990404] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: SUCCESS [ 1045.990649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.990857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.991170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.991373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.991519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.991577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.991716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.991948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.991948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.992130] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.429442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.429628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.429693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.429896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.430009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.430113] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 is going to be created. [ 1046.462272] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.462397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.462486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.462696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.462852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.473605] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: UNINITIALIZED for 2s [ 1046.494241] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.494397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.494449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.494673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.494847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.494955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.495274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.495274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.495274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.495439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.495484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.495572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.495629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.495789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.495901] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.495990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.496054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.496225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.496272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.496328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.496415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.678967] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1046.679136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.000397] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 538cb57d-2620-470f-a3f1-4d52589fec78: rpc.has_security_group_logging(os_id): False [ 1047.024311] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.024454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.024529] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.024785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.024904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.025442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.025606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.025726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.025836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.025973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.026247] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.026382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.026452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.026635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.026743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.027025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.027140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.027208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.027373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.027464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.027565] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 is going to be created. [ 1047.109837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.110641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.110641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.110784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.110948] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.122767] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: IN_PROGRESS for 2s [ 1048.486305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: SUCCESS [ 1048.486728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.486875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.487203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.487531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.487700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.487700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.488095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.488095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.488230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.488323] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.990756] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.136021] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: SUCCESS [ 1049.136295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.494126] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e337e995-ce59-42bc-8ff2-80fd5d186e21: rpc.has_security_group_logging(os_id): False [ 1049.518235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.518420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.518481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.518665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.518754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.518991] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.519104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.519189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.519350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.519418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.519505] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 is going to be created. [ 1049.603666] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.603666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.603940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.603998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.604254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.616744] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: IN_PROGRESS for 2s [ 1049.901399] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1049.901494] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1051.630478] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: SUCCESS [ 1051.630478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.583762] env[66919]: INFO networking_nsxv3.common.synchronization [req-cc165b17-baff-41a3-8b76-ed73cf5dc711 req-9adc3aea-0e48-47a1-ae6a-9113d696efa5 tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1053.584887] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1053.584887] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.584887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.584887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.585082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.585537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.585537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.585537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.585537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.585716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.585716] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.963383] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.963598] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.963836] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.964391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.965040] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.965302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.965421] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.965758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.965968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.966660] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.966860] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.967038] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.967209] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.967402] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.967563] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.967746] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.990346] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.990581] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.990779] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.991143] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-561" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.991390] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-000da06c-b8e5-486d-92f0-adaf0b282cc3 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.991634] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.991802] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.992102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.992243] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000da06c-b8e5-486d-92f0-adaf0b282cc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.088261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.088383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.088453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.088660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.088758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.088939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.089043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.089099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.089258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.089338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.089419] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1054.118123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.118361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.118361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.118566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.118707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.129515] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1054.494721] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.495016] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.495340] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.495648] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.495831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.495831] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 000da06c-b8e5-486d-92f0-adaf0b282cc3 not found, creating... [ 1054.495831] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.496613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.496749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.497063] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.497255] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.497690] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.497899] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.498238] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.498588] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.498847] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.499394] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 000da06c-b8e5-486d-92f0-adaf0b282cc3 is going to be created. [ 1054.521884] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.522162] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.522290] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.522566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.522789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.523033] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.243169] env[66919]: INFO networking_nsxv3.common.synchronization [req-cc165b17-baff-41a3-8b76-ed73cf5dc711 req-1b7090a5-f097-4a20-84d6-48d05117fded service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 1055.243411] env[66919]: INFO networking_nsxv3.common.synchronization [req-cc165b17-baff-41a3-8b76-ed73cf5dc711 req-1b7090a5-f097-4a20-84d6-48d05117fded service nova] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1055.243453] env[66919]: INFO networking_nsxv3.common.synchronization [req-cc165b17-baff-41a3-8b76-ed73cf5dc711 req-1b7090a5-f097-4a20-84d6-48d05117fded service nova] Enqueued Resource ID: 000da06c-b8e5-486d-92f0-adaf0b282cc3 with Priority: HIGHEST for action port [ 1055.244087] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_rules [ 1055.244087] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1055.244251] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 000da06c-b8e5-486d-92f0-adaf0b282cc3 with Priority: HIGHEST for action port [ 1055.244718] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.244718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.244718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.244906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.245029] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.245867] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.245970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.246178] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-000da06c-b8e5-486d-92f0-adaf0b282cc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.246258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.246302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.246555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.246555] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('000da06c-b8e5-486d-92f0-adaf0b282cc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.301241] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c6ca070-d50d-487f-b2c9-6ac76677548d req-1b2466d3-8a65-4c5a-bb09-cbc8a8a02163 tempest-VolumesAdminNegativeTest-1221304702 tempest-VolumesAdminNegativeTest-1221304702-project-member] Enqueued Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1055.302961] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGHEST for action security_group_members [ 1055.303506] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.303712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.303853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.304606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.304872] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.305067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.305186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.305452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.305595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.305748] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.621726] env[66919]: INFO networking_nsxv3.common.synchronization [req-f894215f-a2ba-454c-9c4a-741ed88debf0 req-b97fecdb-f783-45ba-aaaa-2b9e6aaf1068 tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 1055.622592] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGHEST for action security_group_members [ 1055.623282] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.623282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.623458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.623581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.623795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.623945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.624065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.624286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.624389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.624490] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.748729] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.748854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.750178] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 000da06c-b8e5-486d-92f0-adaf0b282cc3 with status ACTIVE [ 1055.750371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.750489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.750851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.750851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.750851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.751070] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.751137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.751232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.751337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.751413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.751592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.751683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.751738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.751877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.751981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.752031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 000da06c-b8e5-486d-92f0-adaf0b282cc3 is going to be updated. [ 1055.777170] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.777293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.777327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.777722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.777874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.778052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-000da06c-b8e5-486d-92f0-adaf0b282cc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.809140] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.809370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.809471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.809709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.809824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.810051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.810313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.810437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.810636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.810723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.810825] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 is going to be updated. [ 1055.844359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.844624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.844938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.846060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.846135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.868227] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: IN_PROGRESS for 2s [ 1056.127328] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.127328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.127328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.127328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.127328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.127527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.127621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.127684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.127831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.127903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.127998] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 is going to be updated. [ 1056.142909] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1056.142909] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.142909] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.142909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.142909] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.158900] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.158900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.158900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.158900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.158900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.167225] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: IN_PROGRESS for 2s [ 1056.645681] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.150319] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.652454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.652761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.652761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.652889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.653064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.653156] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1057.685073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.685326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.685326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.685507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.685656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.694475] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1057.880628] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 538cb57d-2620-470f-a3f1-4d52589fec78 in Status: SUCCESS [ 1057.880850] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 deletion is rescheduled due to dependency. [ 1057.880983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.179290] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: IN_PROGRESS for 4s [ 1059.704259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1059.704629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.704708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.704920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.705121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.705740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.705831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.706019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.706136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.706182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.706283] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.189773] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a87b0710-8423-4a57-8221-4ad054db58d7 in Status: SUCCESS [ 1060.190092] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 deletion is rescheduled due to dependency. [ 1060.191016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.208781] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.208934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.209756] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.209756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.210052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.210052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.210133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.210133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.210271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.210417] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.210503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.210560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.210698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.210762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.210839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.210925] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.624213] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1060.624313] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1060.712921] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0b1967b-4591-4210-b122-446732ce3041: rpc.has_security_group_logging(os_id): False [ 1060.731678] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.731940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.732073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.732301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.732469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.732671] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.732806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.732837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.732991] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.733101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.733295] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.733391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.733456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.733594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.733666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.733859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.733952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.734023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.734159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.734244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.734314] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1060.861760] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.862090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.862090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.862311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.862742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.884031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1060.937746] env[66919]: INFO networking_nsxv3.common.synchronization [req-d5dc2b3e-ed95-438d-9d6a-aa0378e2e804 req-35e381e4-0899-4367-9a56-b342c2bb6550 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1060.938387] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1060.938773] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.938927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.938983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.939235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.939484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.939618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.939682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.939842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.939925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.940029] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.264813] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.265115] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.265247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.265582] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.265856] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.266023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.266139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.266356] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.266503] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.266732] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.266843] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1061.266949] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1061.267064] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1061.267169] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1061.267268] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1061.267395] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1061.287714] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1061.287714] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1061.287714] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1061.287925] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.288867] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-e723c568-e85a-40b4-b1b6-f6740f3aed20 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.288867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.288867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.288867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.289070] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e723c568-e85a-40b4-b1b6-f6740f3aed20',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.442704] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.442864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.442938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.443185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.443281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.443476] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.443581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.443633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.443831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.443935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.444034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c already deleted. [ 1061.444118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.793771] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.794209] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.794452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.794878] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.795080] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.795270] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port e723c568-e85a-40b4-b1b6-f6740f3aed20 not found, creating... [ 1061.795584] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.795837] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.795908] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.796153] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.796294] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.796582] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.796779] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.796962] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.797136] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.798055] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.798055] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: e723c568-e85a-40b4-b1b6-f6740f3aed20 is going to be created. [ 1061.819637] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.819972] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.820174] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.820556] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.820906] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.821281] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.545260] env[66919]: INFO networking_nsxv3.common.synchronization [req-d5dc2b3e-ed95-438d-9d6a-aa0378e2e804 req-dfe70ce5-5e27-44c2-9fd0-3b6c801b6600 service nova] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1062.545794] env[66919]: INFO networking_nsxv3.common.synchronization [req-d5dc2b3e-ed95-438d-9d6a-aa0378e2e804 req-dfe70ce5-5e27-44c2-9fd0-3b6c801b6600 service nova] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1062.545794] env[66919]: INFO networking_nsxv3.common.synchronization [req-d5dc2b3e-ed95-438d-9d6a-aa0378e2e804 req-dfe70ce5-5e27-44c2-9fd0-3b6c801b6600 service nova] Enqueued Resource ID: e723c568-e85a-40b4-b1b6-f6740f3aed20 with Priority: HIGHEST for action port [ 1062.546198] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_rules [ 1062.546922] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1062.546922] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e723c568-e85a-40b4-b1b6-f6740f3aed20 with Priority: HIGHEST for action port [ 1062.546922] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.546922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.546922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.547383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.547383] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.548027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.548111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.548146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.548297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.548546] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.548546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.548641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.548717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.548800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.549522] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.549677] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e723c568-e85a-40b4-b1b6-f6740f3aed20 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.549762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.550058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.550058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.550058] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e723c568-e85a-40b4-b1b6-f6740f3aed20',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.900466] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1062.900466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.052197] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.052536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.052621] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.053482] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e723c568-e85a-40b4-b1b6-f6740f3aed20 with status ACTIVE [ 1063.053694] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.053793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.053922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.054148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.054377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.054990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.055403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.055480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.055690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.055776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.055972] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.056229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.056229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.056400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.056448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.056566] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e723c568-e85a-40b4-b1b6-f6740f3aed20 is going to be updated. [ 1063.083175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.083175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.083175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.083175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.083175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.083175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e723c568-e85a-40b4-b1b6-f6740f3aed20" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.559261] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.061768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.062256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.062256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.062376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.062527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.062659] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c is going to be created. [ 1064.089747] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.089984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.089984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.090218] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.090376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.100648] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: UNINITIALIZED for 2s [ 1065.359551] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c12a9e3-4a9f-4816-8edb-d6463ba2a8ba req-f83229b4-1cbf-4571-88b9-bb6a8931c361 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1065.361052] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1065.361052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.361052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.361052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.361052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.361355] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.361355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.361355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.361842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.361842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.361842] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.753299] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.753523] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.753694] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.753997] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.754304] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.754498] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.754681] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.754919] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.755113] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.755357] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.755509] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.755643] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.755778] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.755955] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1065.756126] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.756282] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.778673] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.778824] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1065.778984] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.779191] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.779546] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-dede1f1d-9961-4bcf-8da6-0406ad2070c4 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.779755] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.779882] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.780372] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.780452] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dede1f1d-9961-4bcf-8da6-0406ad2070c4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.845344] env[66919]: INFO networking_nsxv3.common.synchronization [req-99a49385-daa0-4043-9e1c-8142afc2eae5 req-52c6731a-079d-4291-a236-6e43b7c5d4be tempest-ServerDiskConfigTestJSON-1404479637 tempest-ServerDiskConfigTestJSON-1404479637-project-member] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1065.845413] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGHEST for action security_group_members [ 1065.845687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.845803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.845874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.846085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.846304] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.846422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.846494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.846658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.846755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.846849] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.864544] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.864544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.864824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.864903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.864995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.865215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.865316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.865378] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.865590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.865675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.865983] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1065.911230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.911440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.911481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.911682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.911831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.923187] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1066.113485] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: SUCCESS [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.113485] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.113485] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.285027] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.285027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port dede1f1d-9961-4bcf-8da6-0406ad2070c4 not found, creating... [ 1066.285027] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.285027] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.286231] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.286760] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.286934] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.287192] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.287334] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.287487] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: dede1f1d-9961-4bcf-8da6-0406ad2070c4 is going to be created. [ 1066.309832] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.310077] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.310204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.310475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.310703] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.310959] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.352162] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.352748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.354502] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.354502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.355512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.355757] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be updated. [ 1066.411252] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.411703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.411703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.411896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.412062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.424083] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: IN_PROGRESS for 2s [ 1066.616316] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.067035] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c12a9e3-4a9f-4816-8edb-d6463ba2a8ba req-29680b40-4e17-4e1d-b4df-becbe32b428e service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1067.067035] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c12a9e3-4a9f-4816-8edb-d6463ba2a8ba req-29680b40-4e17-4e1d-b4df-becbe32b428e service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1067.067035] env[66919]: INFO networking_nsxv3.common.synchronization [req-4c12a9e3-4a9f-4816-8edb-d6463ba2a8ba req-29680b40-4e17-4e1d-b4df-becbe32b428e service nova] Enqueued Resource ID: dede1f1d-9961-4bcf-8da6-0406ad2070c4 with Priority: HIGHEST for action port [ 1067.067035] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1067.067035] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1067.069187] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dede1f1d-9961-4bcf-8da6-0406ad2070c4 with Priority: HIGHEST for action port [ 1067.069530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.069656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.069723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.069925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.069999] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.072319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.072319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.072703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-dede1f1d-9961-4bcf-8da6-0406ad2070c4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.072703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.072863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.073416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.073416] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dede1f1d-9961-4bcf-8da6-0406ad2070c4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.119585] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 754aa366-08b4-46d7-a4e2-292d8016099c: rpc.has_security_group_logging(os_id): False [ 1067.142681] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.142846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.142927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.143167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.143271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.143471] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.143633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.143633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.143782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.143856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.143923] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c is going to be created. [ 1067.209527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.209527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.209527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.209527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.209527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.223108] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: IN_PROGRESS for 2s [ 1067.575185] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.575573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.575573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dede1f1d-9961-4bcf-8da6-0406ad2070c4 with status ACTIVE [ 1067.575817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.575975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.575975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.576195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.576304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.576477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.576586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.576650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.577412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.577412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.577412] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.577412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.577412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.577412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.577712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.577712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dede1f1d-9961-4bcf-8da6-0406ad2070c4 is going to be updated. [ 1067.599614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.599818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.599908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.600161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.600312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.600488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dede1f1d-9961-4bcf-8da6-0406ad2070c4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.934078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1067.934297] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1067.934430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.934622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.934882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.935126] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.935299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.935383] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.935588] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.935696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.935802] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.433432] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0b1967b-4591-4210-b122-446732ce3041 in Status: SUCCESS [ 1068.433618] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0b1967b-4591-4210-b122-446732ce3041 deletion is rescheduled due to dependency. [ 1068.433738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.438347] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.790936] env[66919]: INFO networking_nsxv3.common.synchronization [req-c8ed554f-8943-4221-8714-4ee5b29ce11d req-ff0f831c-6a19-43b1-8ee5-53a01a646bb7 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1068.791662] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1068.792087] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.792211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.792281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.792478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.792642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.793400] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.793473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.793642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.793730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.793829] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.940340] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.125239] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.125502] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.125556] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.125884] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.126186] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.126386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.126541] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.126815] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.126991] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.127279] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.127412] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1069.127548] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1069.127671] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1069.127803] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1069.127940] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1069.128117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1069.149957] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1069.150170] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1069.150384] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1069.150573] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.150890] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-213ae287-c0f3-48c2-9521-6c8355d5bf3b taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.151085] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.151233] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.151564] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.151698] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213ae287-c0f3-48c2-9521-6c8355d5bf3b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.238218] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: SUCCESS [ 1069.238442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.298723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.298923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.298993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.299287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.299406] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.299617] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.299750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.299833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.300019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.300108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.300259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1069.331392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.331634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.331730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.332025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.332216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.341858] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1069.445873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.446102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.446158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.446363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.446480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.446583] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1069.475922] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.476130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.476173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.476348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.476490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.487661] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1069.654326] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.654536] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.654699] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.655050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.655204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.655357] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 213ae287-c0f3-48c2-9521-6c8355d5bf3b not found, creating... [ 1069.655702] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.655920] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.656059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.656291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.656427] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.656711] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.656862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.656978] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.657237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.657394] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.657540] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 213ae287-c0f3-48c2-9521-6c8355d5bf3b is going to be created. [ 1069.681030] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.681328] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.681602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.681951] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.682284] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.682604] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.020496] env[66919]: INFO networking_nsxv3.common.synchronization [req-87c208c5-d766-493a-9b86-4c763d0439e3 req-2b326e82-0ee2-4583-97c2-5eaaa44e2585 tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 1070.021131] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 1070.021457] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.021641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.021641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.021849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.022012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.022110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.022173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.022321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.022404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.022497] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.419180] env[66919]: INFO networking_nsxv3.common.synchronization [req-c8ed554f-8943-4221-8714-4ee5b29ce11d req-e662ec95-6d4f-4077-846c-b684f8197267 service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1070.419180] env[66919]: INFO networking_nsxv3.common.synchronization [req-c8ed554f-8943-4221-8714-4ee5b29ce11d req-e662ec95-6d4f-4077-846c-b684f8197267 service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1070.419180] env[66919]: INFO networking_nsxv3.common.synchronization [req-c8ed554f-8943-4221-8714-4ee5b29ce11d req-e662ec95-6d4f-4077-846c-b684f8197267 service nova] Enqueued Resource ID: 213ae287-c0f3-48c2-9521-6c8355d5bf3b with Priority: HIGHEST for action port [ 1070.419180] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1070.419599] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1070.420957] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 213ae287-c0f3-48c2-9521-6c8355d5bf3b with Priority: HIGHEST for action port [ 1070.421271] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.421418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.421473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.421657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.421741] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.423900] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.423900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.423900] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-213ae287-c0f3-48c2-9521-6c8355d5bf3b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.423900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.423900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.423900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.423900] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('213ae287-c0f3-48c2-9521-6c8355d5bf3b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.524430] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.925178] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.925352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.925555] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 213ae287-c0f3-48c2-9521-6c8355d5bf3b with status ACTIVE [ 1070.925728] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.925842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.925978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.926195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.926302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.926505] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.926622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.926707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.928036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.928301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.928586] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.928757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.928910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.929120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.929232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.929450] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 213ae287-c0f3-48c2-9521-6c8355d5bf3b is going to be updated. [ 1070.954874] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.954874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.954874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.955173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.955202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.955363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-213ae287-c0f3-48c2-9521-6c8355d5bf3b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.026679] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.225018] env[66919]: INFO networking_nsxv3.common.synchronization [req-18f701de-8d07-46c5-a0dc-f4c9451f5edd req-0467e77a-abbc-49fc-9408-2cec4eda4b05 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1071.225258] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1071.227395] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.227395] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.227395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.227395] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.356430] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1071.356696] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 deletion is rescheduled due to dependency. [ 1071.356778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.357747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.357980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.358256] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.358366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.358439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.358601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.358688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.358836] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.502103] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1071.502209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.502806] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.503071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.503469] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.503469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.503469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.503635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.503705] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.503789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.503923] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.528664] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.529428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.529428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.529428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.529428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.529624] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 1071.560424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.560974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.561099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.561328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.561500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.572245] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.572601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.572892] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.573338] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.573736] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.573930] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.574067] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.574297] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.574441] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.574644] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.574755] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.575151] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.575252] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.575321] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.575434] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.575571] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.577392] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 1071.595402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.595402] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.595751] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.595751] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.596295] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.596471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.596471] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.596929] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.597053] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c91c2-2ebc-47a4-8462-c5c8d98c83dc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.729277] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.865707] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.009085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.009085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.009085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.009085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.009608] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.010274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.010274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.010274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.010534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.011164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.011164] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.011164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.011398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.011767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.011993] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.012150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.012251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.012465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.012576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.012698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.013470] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.099568] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.099897] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.100071] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.100424] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.100661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.100883] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port de7c91c2-2ebc-47a4-8462-c5c8d98c83dc not found, creating... [ 1072.101307] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.101549] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.101738] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.102082] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.102306] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.102762] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.102996] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.103222] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.103512] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.103740] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.103919] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: de7c91c2-2ebc-47a4-8462-c5c8d98c83dc is going to be created. [ 1072.126653] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.127583] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.127583] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.127583] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.127789] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.127918] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.231420] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.367680] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.515797] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 1072.536761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.536931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.537022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.537302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.537465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.537776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.538543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.538543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.538543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.538543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.538721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.538768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.538859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.538975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.539102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.539369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.539513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.539629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.539857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.539993] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.540142] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1072.612785] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.613056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.613114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.613360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.613587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.627200] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1072.735473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.735649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.735718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.735951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.737136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.737439] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be updated. [ 1072.776470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.777465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.777575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.777789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.778059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.789942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1072.871576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.873630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.873828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.874970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.875460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.875800] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1072.908939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.910136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.910136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.910136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.910136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.920042] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1073.330715] env[66919]: INFO networking_nsxv3.common.synchronization [req-18f701de-8d07-46c5-a0dc-f4c9451f5edd req-f05dd627-a1d7-4dc0-b647-a05be1f81499 service nova] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1073.330980] env[66919]: INFO networking_nsxv3.common.synchronization [req-18f701de-8d07-46c5-a0dc-f4c9451f5edd req-f05dd627-a1d7-4dc0-b647-a05be1f81499 service nova] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1073.331213] env[66919]: INFO networking_nsxv3.common.synchronization [req-18f701de-8d07-46c5-a0dc-f4c9451f5edd req-f05dd627-a1d7-4dc0-b647-a05be1f81499 service nova] Enqueued Resource ID: de7c91c2-2ebc-47a4-8462-c5c8d98c83dc with Priority: HIGHEST for action port [ 1073.331951] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_rules [ 1073.332205] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1073.332350] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de7c91c2-2ebc-47a4-8462-c5c8d98c83dc with Priority: HIGHEST for action port [ 1073.332760] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.333229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.333229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.333480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.333599] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.334692] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.336196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.336979] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.336979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.336979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.337290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.337408] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de7c91c2-2ebc-47a4-8462-c5c8d98c83dc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.590148] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 1073.590408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.680224] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-49896568-4c66-443f-91e2-dd1be8913a98 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1073.680776] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1073.681090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.681217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.681283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.681474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.681624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.681720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.681781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.681926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.682019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.682148] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.840691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.840883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.840965] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de7c91c2-2ebc-47a4-8462-c5c8d98c83dc with status ACTIVE [ 1073.841148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.841257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.841322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.841534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.841627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.841796] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.841893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.841955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.842119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.842195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.842503] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.842503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.842629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.842680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.842755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.843146] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de7c91c2-2ebc-47a4-8462-c5c8d98c83dc is going to be updated. [ 1073.868424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.868606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.868654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.868864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.869161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de7c91c2-2ebc-47a4-8462-c5c8d98c83dc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.983903] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-68a2a387-166c-44f4-99de-46369826513e tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1073.984623] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1073.987181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.987341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.184155] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.184305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.184353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.184583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.184677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.185085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.185085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.185085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.185248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.185311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.185401] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1074.214770] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.214977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.215059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.215353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.215507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.225379] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1074.293968] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-792 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.293968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-792" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-792" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-792" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.298024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.298024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.298024] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.298024] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.298024] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.298024] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.298024] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.298024] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.298024] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.322756] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.323090] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.323282] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.323496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-792" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.323890] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-656218ff-0318-4f4c-810a-7971909b4df8 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.324124] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.324275] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.324685] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.324865] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('656218ff-0318-4f4c-810a-7971909b4df8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.640972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1074.641340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.808075] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1074.808319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.808500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.808735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.808928] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.809061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.809131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.809291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.809374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.809478] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.834104] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.834104] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 656218ff-0318-4f4c-810a-7971909b4df8 not found, creating... [ 1074.834104] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.834104] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.834596] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.834596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.834596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.834812] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.835821] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.835821] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 656218ff-0318-4f4c-810a-7971909b4df8 is going to be created. [ 1074.864894] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.864894] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.864894] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.864894] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.864894] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.865507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.932399] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1074.932399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.932642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.932915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.933246] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.933427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.933533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.933698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.933812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.933905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.934039] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.311899] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.436300] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.575033] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-6d40cc96-8925-4255-a445-022e915a452a service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1075.575033] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-6d40cc96-8925-4255-a445-022e915a452a service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1075.575235] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-6d40cc96-8925-4255-a445-022e915a452a service nova] Enqueued Resource ID: 656218ff-0318-4f4c-810a-7971909b4df8 with Priority: HIGHEST for action port [ 1075.575384] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1075.575505] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1075.575592] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656218ff-0318-4f4c-810a-7971909b4df8 with Priority: HIGHEST for action port [ 1075.576767] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.576941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.577123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.577160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.577243] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.578148] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.578742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.578742] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-656218ff-0318-4f4c-810a-7971909b4df8 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.578742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.578742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.578742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.579062] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('656218ff-0318-4f4c-810a-7971909b4df8',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.814565] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.939406] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 1075.959936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.960148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.960148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.960330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.960420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.960677] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.960777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.960842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.960988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.961077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.961165] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1076.057143] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.057386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.057599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.057884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.057884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.076999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1076.080755] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.080938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.081106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 656218ff-0318-4f4c-810a-7971909b4df8 with status ACTIVE [ 1076.081287] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.081393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.081455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.081793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.081793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.081935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.082041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.082828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.083092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.083729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.083823] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.084023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.084134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.084328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.084456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.084643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 656218ff-0318-4f4c-810a-7971909b4df8 is going to be updated. [ 1076.113361] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.113507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.113579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.113870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.113933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.114103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-656218ff-0318-4f4c-810a-7971909b4df8" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.254438] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1076.254634] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 deletion is rescheduled due to dependency. [ 1076.254754] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.254913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.255191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.255421] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.255552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.255619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.255775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.255857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.255954] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.318764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.319014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.319014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.319222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.319316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.319610] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be updated. [ 1076.360082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.360313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.360313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.360524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.360675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.371077] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1076.393740] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.393939] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-596" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.394351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-596" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.394766] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-596" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.395075] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.395261] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.395395] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.395625] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.395774] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.395987] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.396142] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.396257] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.396366] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.396503] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.396612] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.396749] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.414672] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.414858] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.414948] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.415177] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-596" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.415497] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.415664] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.416183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.416183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.416279] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d62ab4f-6ace-4134-ab2f-9f85b05abfd6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.758120] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.918701] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.919102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.919102] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.919343] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.919497] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.919650] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 not found, creating... [ 1076.919907] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.920185] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.920185] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.920500] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.920606] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.920889] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.921065] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.921188] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.921402] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.921543] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.921700] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 is going to be created. [ 1076.946233] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.946355] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.946484] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.946752] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.946972] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.947291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.262122] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-5121a972-a318-4f96-967e-34ff04f3e35f service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-5121a972-a318-4f96-967e-34ff04f3e35f service nova] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [req-285565e5-3e19-4171-8377-9e3865d20144 req-5121a972-a318-4f96-967e-34ff04f3e35f service nova] Enqueued Resource ID: 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 with Priority: HIGHEST for action port [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_rules [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1077.687311] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 with Priority: HIGHEST for action port [ 1077.687716] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.688083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.688466] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.688703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.690210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.690210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.690210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.690210] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.690210] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d62ab4f-6ace-4134-ab2f-9f85b05abfd6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.764833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.765035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.765164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.765466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.766875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.766875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1077.798537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.798537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.798865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.801340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.801340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.808553] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1078.096655] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1078.096655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.192530] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 with status ACTIVE [ 1078.192729] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.194078] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.194078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.194078] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.194556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.194556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.194556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.194556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.194556] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d62ab4f-6ace-4134-ab2f-9f85b05abfd6 is going to be updated. [ 1078.221577] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.222723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.224115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.224115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.224115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.224115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d62ab4f-6ace-4134-ab2f-9f85b05abfd6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.386509] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1078.386753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.387144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.387250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.387924] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.387924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.387924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.387924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.388125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.388272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.388376] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.892647] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.400796] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da45b7e6-efbe-4bfe-be25-61bfeb440e55: rpc.has_security_group_logging(os_id): False [ 1079.403989] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5e6bd0ee-99dc-4c72-b28b-69e7c0d08aed tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1079.404970] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1079.405326] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.405697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.405781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.406105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.406185] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.428484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.428484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.428484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.428484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.428694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.428816] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.428911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.428963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.429129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.429198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.431204] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be updated. [ 1079.500826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.500826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.500826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.501469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.501469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.516924] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1079.588834] env[66919]: INFO networking_nsxv3.common.synchronization [None req-753a09be-6366-473d-84b6-67a1f0a0afdb tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1079.589726] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1079.590468] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.590594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.821161] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1079.821161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.821161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.821161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.822030] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.822030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.822030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.822030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.822030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.822257] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.927734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.927959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.927959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.928185] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.928282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.928381] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 already deleted. [ 1079.928464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.928620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.928777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.928860] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.324415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.451723] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.451723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.451723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.451723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.451723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.451723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 already deleted. [ 1080.451723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.630684] env[66919]: INFO networking_nsxv3.common.synchronization [req-7aab9b3f-41cb-4188-b2f7-4a0880c8e0bd req-967100f8-220f-4cbc-979c-8026f0133af0 tempest-ServerActionsV293TestJSON-87740859 tempest-ServerActionsV293TestJSON-87740859-project-member] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1080.631689] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGHEST for action security_group_members [ 1080.631689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.631830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.631922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.632947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.632947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.632947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.632947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.632947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.633214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.633214] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.829500] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.135918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.135918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.135918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.136160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.136160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.136347] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.136463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.136536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.136690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.136765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.136849] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 is going to be updated. [ 1081.144910] env[66919]: INFO networking_nsxv3.common.synchronization [req-0e0d2264-d35c-4f40-bc33-c0cd73184a4b req-f84493d2-9dc1-48da-a92b-1ce63cfa4711 tempest-ServersTestBootFromVolume-1784369835 tempest-ServersTestBootFromVolume-1784369835-project-member] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1081.145582] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1081.145792] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.145907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.145968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.146241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.146532] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.146532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.146656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.146718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.146799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.146899] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.165866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.166095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.166095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.166442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.166571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.178068] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: IN_PROGRESS for 2s [ 1081.333690] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.333845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.333919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.334152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.334241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.334336] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1081.363234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.363382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.363487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.363667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.363808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.375023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1081.534836] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1081.535181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.648963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.649333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.649333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.649459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.649504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.649721] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.649819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.649868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.650031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.651072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.651072] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e already deleted. [ 1081.651072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.721593] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-696 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.721856] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-696" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.721943] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-696" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.722294] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-696" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.722560] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.722718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.722831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.723085] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.723236] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.723443] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.723553] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.723659] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.723764] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.723873] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1081.723984] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.724136] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.745261] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.745424] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1081.745568] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.745759] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-696" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.746089] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-b0f61cb8-54f8-431d-8128-adc0b6428af0 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.746310] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.746445] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.746831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.746984] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f61cb8-54f8-431d-8128-adc0b6428af0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.250220] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.250468] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.250598] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.250882] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.251528] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.251528] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port b0f61cb8-54f8-431d-8128-adc0b6428af0 not found, creating... [ 1082.251528] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.251778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.251778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.252025] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.252162] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.252440] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.252722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.252722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.254554] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.254765] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.255933] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: b0f61cb8-54f8-431d-8128-adc0b6428af0 is going to be created. [ 1082.286491] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.286491] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.286712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.286865] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.287131] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.287364] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.817044] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c775e1a-a5fe-4407-81f2-876ba2393f33 req-44fc3c8e-e53b-4456-8c9e-6cba7702862e tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1082.817588] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1082.817888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.818022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.818094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.818288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.818442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.818541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.818601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.818768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.818823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.818918] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.997455] env[66919]: INFO networking_nsxv3.common.synchronization [req-0e0d2264-d35c-4f40-bc33-c0cd73184a4b req-564ada12-9c12-4e9c-a412-4174017d130b service nova] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1082.997600] env[66919]: INFO networking_nsxv3.common.synchronization [req-0e0d2264-d35c-4f40-bc33-c0cd73184a4b req-564ada12-9c12-4e9c-a412-4174017d130b service nova] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1082.997737] env[66919]: INFO networking_nsxv3.common.synchronization [req-0e0d2264-d35c-4f40-bc33-c0cd73184a4b req-564ada12-9c12-4e9c-a412-4174017d130b service nova] Enqueued Resource ID: b0f61cb8-54f8-431d-8128-adc0b6428af0 with Priority: HIGHEST for action port [ 1082.998234] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_rules [ 1082.998365] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1082.998460] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0f61cb8-54f8-431d-8128-adc0b6428af0 with Priority: HIGHEST for action port [ 1082.998931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.998931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.998931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.999270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.999344] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.001261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.001397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.001474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.001625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.001773] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.001870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.001920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.002085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.002169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.002256] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.004203] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0f61cb8-54f8-431d-8128-adc0b6428af0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.004203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.004203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.004203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.004203] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0f61cb8-54f8-431d-8128-adc0b6428af0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.190216] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 in Status: SUCCESS [ 1083.190403] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 deletion is rescheduled due to dependency. [ 1083.190526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.205041] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.205385] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.205549] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.205853] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.206137] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.206450] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.206521] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.206752] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.206900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.207119] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.207231] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1083.207339] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1083.207465] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1083.207626] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1083.207700] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1083.207833] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1083.226801] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1083.226968] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1083.227131] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1083.227307] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.227632] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-46378080-5f6a-4eb0-921f-6e0806cef243 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.227804] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.227922] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.228267] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.228409] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46378080-5f6a-4eb0-921f-6e0806cef243',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.322349] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.386695] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.386695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.386695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.386695] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.388939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.388939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.388939] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.505475] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.507092] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.507304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.507462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0f61cb8-54f8-431d-8128-adc0b6428af0 with status ACTIVE [ 1083.507559] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.507675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.507755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.507975] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.509437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.509437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.509437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.509801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.509801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.509801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.509801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.510150] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0f61cb8-54f8-431d-8128-adc0b6428af0 is going to be updated. [ 1083.532850] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.533067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.533117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.533361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.533518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.533694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0f61cb8-54f8-431d-8128-adc0b6428af0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.731640] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.731640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.731862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.732084] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.732254] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.732410] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 46378080-5f6a-4eb0-921f-6e0806cef243 not found, creating... [ 1083.732679] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.732833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.732948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.733518] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.733518] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.733649] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.733757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.733885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.734108] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.734241] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.734378] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 46378080-5f6a-4eb0-921f-6e0806cef243 is going to be created. [ 1083.765459] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.765757] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.765890] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.766459] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.766459] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.766685] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.824686] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.891137] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.891335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.891524] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.012341] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.326278] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.326442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.326521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.326774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.326865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.326960] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1084.359515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.359660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.359720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.360176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.360176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.369270] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1084.393797] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.447284] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c775e1a-a5fe-4407-81f2-876ba2393f33 req-273674fa-171a-4e31-b8b5-4b85ec942b22 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1084.447470] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c775e1a-a5fe-4407-81f2-876ba2393f33 req-273674fa-171a-4e31-b8b5-4b85ec942b22 service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1084.447637] env[66919]: INFO networking_nsxv3.common.synchronization [req-6c775e1a-a5fe-4407-81f2-876ba2393f33 req-273674fa-171a-4e31-b8b5-4b85ec942b22 service nova] Enqueued Resource ID: 46378080-5f6a-4eb0-921f-6e0806cef243 with Priority: HIGHEST for action port [ 1084.448200] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1084.448357] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1084.448490] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46378080-5f6a-4eb0-921f-6e0806cef243 with Priority: HIGHEST for action port [ 1084.448786] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.448918] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.448986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.449213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.449310] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.450222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.450330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.450537] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-46378080-5f6a-4eb0-921f-6e0806cef243 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.450635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.450690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.450882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.450970] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46378080-5f6a-4eb0-921f-6e0806cef243',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.517021] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.517021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.518064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.518064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.518064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.518064] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e is going to be created. [ 1084.547983] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.548183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.548183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.548379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.548553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.564423] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: UNINITIALIZED for 2s [ 1084.896396] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.896744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.896744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.897500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.897500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.897500] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1084.935571] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.935822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.935933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.936196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.936409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.948268] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1084.953293] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.953455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.953657] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 46378080-5f6a-4eb0-921f-6e0806cef243 with status ACTIVE [ 1084.953840] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.953947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.954023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.954258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.954347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.954542] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.954685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.954685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.954850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.954939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.955142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.955288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.955288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.955525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.955607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.955684] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 46378080-5f6a-4eb0-921f-6e0806cef243 is going to be updated. [ 1084.990196] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.990373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.990436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.990771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.990771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.990966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46378080-5f6a-4eb0-921f-6e0806cef243" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.382512] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1086.382512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.382512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.383451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.383451] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.383451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.383451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.383585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.383585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.383647] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.398205] env[66919]: INFO networking_nsxv3.common.synchronization [None req-df580e96-fb1d-4c3f-b10a-8e04712b06af tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1086.399323] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1086.399928] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.399928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.399928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.400159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.400312] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.400434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.400567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.400733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.400878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.400982] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.583159] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: SUCCESS [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.583159] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.583159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.583159] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.729166] env[66919]: INFO networking_nsxv3.common.synchronization [req-add4c30a-7b77-48c9-87c5-f3c345750e84 req-dee52015-f357-4ef5-ad98-3be4101a87f1 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1086.729745] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1086.730921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.730996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.731051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.731251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.731433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.731536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.731592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.731749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.731837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.731929] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.890270] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.903749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.903749] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.904638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.904638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.937247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.937519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.937677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.937834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.938036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.938150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.938252] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1086.961015] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1086.961198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.961419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.961664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.961876] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.961996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.962146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.962239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.962318] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.962401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.962552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.962668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.962730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.962870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.963018] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.963110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.963170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.963303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.963372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.963454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.963541] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.970204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.970491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.970491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.970591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.970727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.980773] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1087.086976] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.236221] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.236429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.236479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.236759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.236759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.237468] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.237468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.237468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.237468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.237468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.237468] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1087.294303] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.294493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.294617] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.294718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.294865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.305209] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1087.393323] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.466194] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1087.486705] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.487016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.487016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.487219] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.487340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.487701] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.487882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.487936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.488124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.488224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.488595] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.488595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.488711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.488830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.488929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489244] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.489365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.489437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.489603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.489697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.489897] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1087.565379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.565694] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.565832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.566139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.566327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.589809] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f65ecefc-2215-4da9-a836-c6bf34b8534e: rpc.has_security_group_logging(os_id): False [ 1087.607356] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1087.626498] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.626667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.626741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.627055] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.627206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.627422] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.627659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.627659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.627743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.627821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.627908] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e is going to be created. [ 1087.705680] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.705862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.705916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.706386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.706589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.718233] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: IN_PROGRESS for 2s [ 1087.896150] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.896379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.896470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.896914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.896914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.897106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1087.944238] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.944238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.944238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.944238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.944238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.960552] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1088.993380] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1088.993380] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 deletion is rescheduled due to dependency. [ 1088.993380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.333717] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1089.333909] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1089.334062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.631418] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1089.633328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.633328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.633328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.633328] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.734573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: SUCCESS [ 1089.734720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.969193] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1089.969497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.969765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.970085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.970367] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.970544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.970652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.970886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.971027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.972030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.972030] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.136824] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.137165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.137165] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.137415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.137912] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.138047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.138109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.138279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.138367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.138462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.138553] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.473482] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.473962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.474247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.474553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.474794] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.474958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.475085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.475309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.475436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.475539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.475768] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.475884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.475960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.476282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.476479] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.476654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.476758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.476949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.477092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.477220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.477482] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.643403] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.643403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.643403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.643597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.643726] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.643835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.643896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.644074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.644163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.644439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.644439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.644583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.644583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.644671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.644783] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.644877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.644936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.645083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.645157] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.645235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.645326] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.979393] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 1091.003262] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.003466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.003591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.003905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.031365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.031633] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.031756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.031821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.032066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.032158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.032388] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.032495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.032558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.032715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.032788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.032986] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.033093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.033155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.033298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.033373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.033456] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1091.101697] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.101966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.102188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.105186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.105186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.117951] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1091.151243] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b86545e3-6fe4-40a0-b7a2-11e0ad14bf96: rpc.has_security_group_logging(os_id): False [ 1091.207831] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.208024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.208082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.208327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.208407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.211044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.211044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.211044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.211044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.212362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.212362] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1091.425375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.425562] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.425742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.425881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.426079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.449032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1091.654079] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.654079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.654079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.654079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.654079] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.654079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.654079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.654763] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.655041] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.655377] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.655669] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.655904] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.656242] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.656709] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.657021] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.657263] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.679472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.683223] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.683223] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.683223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.683223] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-9acac6c9-3f69-497c-b6ab-cc575f873aea taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.683223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.683223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.683223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.683223] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9acac6c9-3f69-497c-b6ab-cc575f873aea',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.731345] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1091.731345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1092.102774] env[66919]: INFO networking_nsxv3.common.synchronization [None req-88132827-5a51-44f6-9931-37101b4fa769 None None] Enqueued Resource ID: 65a9a208-c719-4989-abc3-ff1468e65383 with Priority: HIGHEST for action port [ 1092.102774] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65a9a208-c719-4989-abc3-ff1468e65383 with Priority: HIGHEST for action port [ 1092.102774] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-65a9a208-c719-4989-abc3-ff1468e65383 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.102774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65a9a208-c719-4989-abc3-ff1468e65383" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.102774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65a9a208-c719-4989-abc3-ff1468e65383" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.102774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65a9a208-c719-4989-abc3-ff1468e65383" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.102774] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65a9a208-c719-4989-abc3-ff1468e65383',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.188496] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.188496] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 9acac6c9-3f69-497c-b6ab-cc575f873aea not found, creating... [ 1092.188496] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.188496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.189940] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.189940] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.192462] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.192462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.192462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.192462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.192462] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.192462] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea is going to be created. [ 1092.216026] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.216026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.216026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.216026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.216026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.217722] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.606227] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65a9a208-c719-4989-abc3-ff1468e65383 [ 1092.606743] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.606929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.607027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.607246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.607368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.607479] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65a9a208-c719-4989-abc3-ff1468e65383 already deleted. [ 1092.607593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65a9a208-c719-4989-abc3-ff1468e65383" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.836416] env[66919]: INFO networking_nsxv3.common.synchronization [req-8591f8a3-3ed9-4f1b-9c95-628e44845bd2 req-724e41b4-1bdd-4796-a0c0-ddd371d090d1 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 1092.837035] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGHEST for action security_group_members [ 1092.837376] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.837498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.837574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.837929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.838132] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.838250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.838317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.838489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.838580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.838677] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.959784] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bb6a296-95f6-4be2-9330-3a70cc607e0b req-9afa729a-ba70-467d-92cc-7aeda3f6fd46 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 1092.959958] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bb6a296-95f6-4be2-9330-3a70cc607e0b req-9afa729a-ba70-467d-92cc-7aeda3f6fd46 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1092.960125] env[66919]: INFO networking_nsxv3.common.synchronization [req-0bb6a296-95f6-4be2-9330-3a70cc607e0b req-9afa729a-ba70-467d-92cc-7aeda3f6fd46 service nova] Enqueued Resource ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea with Priority: HIGHEST for action port [ 1092.960874] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 1092.960874] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1092.961785] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea with Priority: HIGHEST for action port [ 1092.961950] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.962103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.962173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.962376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.962461] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.964085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.964085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.964236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.964349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.964515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.964602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.964667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.964820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.964899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.965035] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.968666] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9acac6c9-3f69-497c-b6ab-cc575f873aea taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.968828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.968871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.969091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.969160] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9acac6c9-3f69-497c-b6ab-cc575f873aea',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.135843] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1093.136018] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.343022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.343022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.343022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.343440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.343440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.343642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.343703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.343759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.343935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.344071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.344300] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be updated. [ 1093.378283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.378479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.378479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.378701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.378852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.396745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: IN_PROGRESS for 2s [ 1093.437031] env[66919]: INFO networking_nsxv3.common.synchronization [req-aec2e1a9-4158-4f0d-b0f5-d20a04ed022d req-5ac753a5-50f6-4483-970d-1604ace9a163 tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1093.437735] env[66919]: INFO networking_nsxv3.common.synchronization [req-accdf10b-70aa-4be5-adbb-8e56d52bbca7 req-203e29ef-1d0f-4c97-8baf-d28d846d846e tempest-ServerRescueNegativeTestJSON-2136640216 tempest-ServerRescueNegativeTestJSON-2136640216-project-member] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 1093.438309] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1093.438466] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGHEST for action security_group_members [ 1093.438764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.439062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.439062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.440065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.440065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.440065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.440065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.440065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.440065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.440065] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.440878] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.441061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.443473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.443473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.443473] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.467785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1093.469354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.471568] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.471568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.471826] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.474117] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9acac6c9-3f69-497c-b6ab-cc575f873aea with status ACTIVE [ 1093.474117] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.474368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.474368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.474493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.474582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.474760] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.474868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.474950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.476612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.476721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.476938] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.477059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.477117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.477279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.477366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.477433] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea is going to be updated. [ 1093.503346] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.503346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.503346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.503346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.503346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.503346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.744907] env[66919]: INFO networking_nsxv3.common.synchronization [req-aec2e1a9-4158-4f0d-b0f5-d20a04ed022d req-978119df-359d-43a9-a9ff-0c1be353670c tempest-ServersTestMultiNic-194134576 tempest-ServersTestMultiNic-194134576-project-member] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1093.745877] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGHEST for action security_group_members [ 1093.745877] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.745877] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.944446] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.945545] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.945675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.945773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.945989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.946100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.946286] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.946385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.946447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.946596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.948168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.948168] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be updated. [ 1093.978562] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.978723] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.978762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.978990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.979132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.980471] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.989391] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: IN_PROGRESS for 2s [ 1094.450266] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.483534] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.483534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.483534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.483684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.483807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.485038] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1094.502758] env[66919]: INFO networking_nsxv3.common.synchronization [None req-dc1cb9a9-0f3d-42cc-be92-5df4e8395366 None None] Enqueued Resource ID: e9f7180d-90a2-492f-99a0-5e20412ae49c with Priority: HIGHEST for action port [ 1094.503019] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9f7180d-90a2-492f-99a0-5e20412ae49c with Priority: HIGHEST for action port [ 1094.503779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9f7180d-90a2-492f-99a0-5e20412ae49c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.503904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9f7180d-90a2-492f-99a0-5e20412ae49c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.503970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9f7180d-90a2-492f-99a0-5e20412ae49c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.504250] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9f7180d-90a2-492f-99a0-5e20412ae49c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.504334] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9f7180d-90a2-492f-99a0-5e20412ae49c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.516656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.516888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.516946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.517268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.517476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.528340] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1094.954333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.954333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.954333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.954333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.954333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.954333] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1094.985098] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.985368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.985368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.986649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.986649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.998591] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1095.007033] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9f7180d-90a2-492f-99a0-5e20412ae49c [ 1095.007259] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.007389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.007458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.007664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.007748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.007936] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9f7180d-90a2-492f-99a0-5e20412ae49c already deleted. [ 1095.007981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9f7180d-90a2-492f-99a0-5e20412ae49c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.407464] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b in Status: SUCCESS [ 1095.407652] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b deletion is rescheduled due to dependency. [ 1095.407767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.936500] env[66919]: INFO networking_nsxv3.common.synchronization [req-85003130-c786-4562-8509-7482b7cc1cef req-d4c62950-d6c9-4542-9801-2fc20d542046 tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1095.937064] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1095.937406] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.937582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.937685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.937976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.938179] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.938283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.938344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.938499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.938580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.938671] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.005750] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 in Status: SUCCESS [ 1096.005750] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 deletion is rescheduled due to dependency. [ 1096.005750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.160231] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-643 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.160455] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.160538] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.160817] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.161433] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.161608] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.161758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.161967] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.162138] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.162551] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.162688] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1096.162796] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1096.162901] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1096.163027] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1096.163211] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1096.163284] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1096.184602] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1096.184769] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1096.184904] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1096.185099] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-643" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.185415] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.185597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.185705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.186108] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.186253] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbb8fd2-7d1e-4b96-b7c2-201879974a23',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.442390] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.442390] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.442390] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 already deleted. [ 1096.442390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.539813] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1096.540069] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.540241] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.540506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.540666] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.540781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.540835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.540998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.541093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.541175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.541266] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.689270] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.689456] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.689547] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.689861] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.690035] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.690234] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 not found, creating... [ 1096.690696] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.690952] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.691111] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.691360] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.691524] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.691859] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.692061] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.692195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.692424] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.692580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.692736] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 is going to be created. [ 1096.715576] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.716279] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.716509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.716910] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.717237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.717517] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.009737] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1097.010074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.010320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.010674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.010945] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.011127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.011216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.011419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.011527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.011645] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.043486] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.044178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.044308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.045032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.046399] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.046523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.046583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.046760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.046890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.046955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.047145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.047246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.047307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.047453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.047594] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.047676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.047729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.047865] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.047929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.048021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.048096] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.433430] env[66919]: INFO networking_nsxv3.common.synchronization [req-85003130-c786-4562-8509-7482b7cc1cef req-0e0c549e-313e-4d59-93cd-9520893a62cb service nova] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1097.433648] env[66919]: INFO networking_nsxv3.common.synchronization [req-85003130-c786-4562-8509-7482b7cc1cef req-0e0c549e-313e-4d59-93cd-9520893a62cb service nova] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1097.433850] env[66919]: INFO networking_nsxv3.common.synchronization [req-85003130-c786-4562-8509-7482b7cc1cef req-0e0c549e-313e-4d59-93cd-9520893a62cb service nova] Enqueued Resource ID: 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 with Priority: HIGHEST for action port [ 1097.434444] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_rules [ 1097.434581] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1097.434673] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 with Priority: HIGHEST for action port [ 1097.434992] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.435152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.435251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.435483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.435593] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.436607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.436734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.436855] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.437114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.437267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.437377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.437445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.438826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.438826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.438826] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.438826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.438826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.438826] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.439885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.439885] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cbb8fd2-7d1e-4b96-b7c2-201879974a23',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.514198] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.514441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.514541] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.514854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.514990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.515339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.515491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.515578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.515786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.515942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.516106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be updated. [ 1097.550096] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8993b03-159d-4cb8-a490-873c724e7d28: rpc.has_security_group_logging(os_id): False [ 1097.553060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.553300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.553448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.553717] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.553954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.567623] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: IN_PROGRESS for 2s [ 1097.573316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.573476] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.573545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.573802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.573923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.574204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.574309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.574353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.574491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.574569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.574741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.574904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.574904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.575178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.575178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.575308] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.575360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.575392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.575526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.575591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.575676] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1097.650204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.650466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.650549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.650764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.650937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.665181] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1097.941305] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.941457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.941634] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 with status ACTIVE [ 1097.941807] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.941910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.941972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.942441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.942441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.942441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.942597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.942597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.942779] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.942858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.943064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.943171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.943249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.943394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.943426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.943493] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0cbb8fd2-7d1e-4b96-b7c2-201879974a23 is going to be updated. [ 1097.944652] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.966488] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.966488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.966488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.967158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.967158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.967158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cbb8fd2-7d1e-4b96-b7c2-201879974a23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.028655] env[66919]: INFO networking_nsxv3.common.synchronization [req-bad8522c-1491-4baf-a260-18deab4ddba5 req-2818b858-6751-4dd6-abb4-6bbcb0847657 tempest-ServersTestJSON-76893119 tempest-ServersTestJSON-76893119-project-member] Enqueued Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1098.029198] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 with Priority: HIGHEST for action security_group_members [ 1098.029507] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e337e995-ce59-42bc-8ff2-80fd5d186e21 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.029629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.029698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.029896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.030069] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.030172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.030225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.030365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.030451] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.030542] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e337e995-ce59-42bc-8ff2-80fd5d186e21',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.447415] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.534341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.534341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.534341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.534341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 is going to be updated. [ 1098.574175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.574615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.574615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.574615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.574837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.587447] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: IN_PROGRESS for 2s [ 1098.689918] env[66919]: INFO networking_nsxv3.common.synchronization [req-d5bc4ed1-7001-4275-84b2-69100ad1fb90 req-f4f9082a-38ef-452f-b309-ddb147951780 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1098.693043] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1098.693043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.693043] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.693043] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.693477] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.950041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.953075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.953075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.953075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.953075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.953075] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 is going to be created. [ 1098.982202] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.982359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.982433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.982650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.982810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.996096] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: UNINITIALIZED for 2s [ 1099.196291] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.578932] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 in Status: SUCCESS [ 1099.579142] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 deletion is rescheduled due to dependency. [ 1099.579259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.682718] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1099.682953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.699499] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.202687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.203039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.203039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.204039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.204039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.204039] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1100.235255] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.235427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.235502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.235658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.235801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.243601] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1100.597810] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 in Status: SUCCESS [ 1100.598421] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e337e995-ce59-42bc-8ff2-80fd5d186e21 deletion is rescheduled due to dependency. [ 1100.598684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e337e995-ce59-42bc-8ff2-80fd5d186e21" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.011208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: SUCCESS [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.014063] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.014063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.014063] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.516242] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.018410] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 905c5896-f3db-4f90-ab61-b62bb3cbee86: rpc.has_security_group_logging(os_id): False [ 1102.040524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.040667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.040746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.040966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.041136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.041313] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.041416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.041478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.041655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.041730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.041822] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 is going to be created. [ 1102.136775] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.136775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.136775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.136775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.136775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.151378] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: IN_PROGRESS for 2s [ 1102.253445] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1102.253709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.595316] env[66919]: INFO networking_nsxv3.common.synchronization [None req-9471ea6d-1b67-428c-acdb-2822ea290709 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1102.596305] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1102.596305] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.596305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.596305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.596484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.596586] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.683357] env[66919]: INFO networking_nsxv3.common.synchronization [None req-31984f67-9c64-44a1-866c-a8aa12be3d86 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1102.683904] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1102.684238] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.684341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.117442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.117628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.117628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.117838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.117910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.118711] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 already deleted. [ 1103.118711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.118711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.118711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.118711] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.640642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.640974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.640974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.641119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.641178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.641683] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 already deleted. [ 1103.641683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.175177] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: SUCCESS [ 1104.175177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.686044] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1107.686044] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1109.907484] env[66919]: INFO networking_nsxv3.common.synchronization [req-d4b8824d-0390-4fb1-b7b4-86aa93060513 req-bc3bfd11-d238-45eb-852a-f21911c2503f tempest-ServerPasswordTestJSON-248770221 tempest-ServerPasswordTestJSON-248770221-project-member] Enqueued Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1109.907484] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1109.907801] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.908675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.908675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.908675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.908857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.908971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.909058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.909238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.909338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.909786] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.258454] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.258659] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.258800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.259090] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.259346] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.259502] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.259613] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.259829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.259970] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.260756] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.260894] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.261016] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.261154] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.261244] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.261342] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.261474] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.264916] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-322 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.265107] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-322" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.265229] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-322" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.265499] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-322" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.265748] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.265900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.266018] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.266225] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.266393] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.266561] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.266669] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1110.266773] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1110.266874] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1110.266977] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1110.267096] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1110.268073] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1110.287321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.287538] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.287719] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.287915] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-322" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.288843] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-22a897d4-97a1-4fbf-b39d-c052b53a5d04 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.289070] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.289194] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.289580] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.289724] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a897d4-97a1-4fbf-b39d-c052b53a5d04',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.292086] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1110.292247] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1110.293043] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1110.293043] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-162" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.293043] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-9acac6c9-3f69-497c-b6ab-cc575f873aea taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.293451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.293451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.293451] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.293597] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9acac6c9-3f69-497c-b6ab-cc575f873aea',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.414097] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.414279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.414320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.414539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.414672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.414820] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.414920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.414983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.415153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.415263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.415333] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e already deleted. [ 1110.415408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.792550] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.792856] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.793058] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.793496] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.793718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.793978] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 22a897d4-97a1-4fbf-b39d-c052b53a5d04 not found, creating... [ 1110.794394] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.794636] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.794835] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.795158] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.795311] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.795596] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.795749] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.795863] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.796089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.796223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.796423] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 22a897d4-97a1-4fbf-b39d-c052b53a5d04 is going to be created. [ 1110.797727] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.797892] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.798028] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.798233] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.798369] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.798629] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.798787] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.798901] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.799116] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.799247] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.799513] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.799663] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.799778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.799976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.800166] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.800309] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea is going to be updated. [ 1110.821024] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.821279] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.821445] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.821741] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.821966] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.822207] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.823767] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.823939] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.824070] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.824311] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.824483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.824678] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.522327] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8bfbafa-f283-4b35-a1a2-2c2cb2cac5fd req-41131f48-7ad1-412e-adf6-ddf75617cc55 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 1111.522568] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8bfbafa-f283-4b35-a1a2-2c2cb2cac5fd req-41131f48-7ad1-412e-adf6-ddf75617cc55 service nova] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1111.522763] env[66919]: INFO networking_nsxv3.common.synchronization [req-a8bfbafa-f283-4b35-a1a2-2c2cb2cac5fd req-41131f48-7ad1-412e-adf6-ddf75617cc55 service nova] Enqueued Resource ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea with Priority: HIGHEST for action port [ 1111.523340] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_rules [ 1111.523474] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1111.523570] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea with Priority: HIGHEST for action port [ 1111.523845] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.523964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.526660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.526926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.527032] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.529270] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.529490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.529567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.529776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.529949] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.530066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.530130] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.530299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.530463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.530575] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.531923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-9acac6c9-3f69-497c-b6ab-cc575f873aea taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.532053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.532125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.532298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.532570] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9acac6c9-3f69-497c-b6ab-cc575f873aea',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.541286] env[66919]: INFO networking_nsxv3.common.synchronization [req-d4b8824d-0390-4fb1-b7b4-86aa93060513 req-c4640b61-aa23-49ac-b42d-e5fd90c17396 service nova] Enqueued Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_rules [ 1111.541514] env[66919]: INFO networking_nsxv3.common.synchronization [req-d4b8824d-0390-4fb1-b7b4-86aa93060513 req-c4640b61-aa23-49ac-b42d-e5fd90c17396 service nova] Enqueued Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1111.541696] env[66919]: INFO networking_nsxv3.common.synchronization [req-d4b8824d-0390-4fb1-b7b4-86aa93060513 req-c4640b61-aa23-49ac-b42d-e5fd90c17396 service nova] Enqueued Resource ID: 22a897d4-97a1-4fbf-b39d-c052b53a5d04 with Priority: HIGHEST for action port [ 1111.542862] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_rules [ 1111.542862] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1111.542994] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22a897d4-97a1-4fbf-b39d-c052b53a5d04 with Priority: HIGHEST for action port [ 1111.543408] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.543663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.543663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.543954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.544198] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.545121] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.545284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.545848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.545848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.545848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.545848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.545848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.546189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.546346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.546428] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.547352] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-22a897d4-97a1-4fbf-b39d-c052b53a5d04 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.547516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.547607] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.547813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.547899] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22a897d4-97a1-4fbf-b39d-c052b53a5d04',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.041241] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9acac6c9-3f69-497c-b6ab-cc575f873aea with status ACTIVE [ 1112.041757] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.041757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.041757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.042156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.042276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.042521] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.042642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.042702] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.042897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.042977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.043203] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.043644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.043721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.043863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.043947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.044149] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9acac6c9-3f69-497c-b6ab-cc575f873aea is going to be updated. [ 1112.045331] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.045435] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.045858] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.050855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.051047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.051128] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.051913] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22a897d4-97a1-4fbf-b39d-c052b53a5d04 with status ACTIVE [ 1112.055052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.055052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.055052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.055052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.055052] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22a897d4-97a1-4fbf-b39d-c052b53a5d04 is going to be updated. [ 1112.072370] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.072580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.073473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.073473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.073473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.073473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9acac6c9-3f69-497c-b6ab-cc575f873aea" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.074848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.075078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.075197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.075449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.075589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.077026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22a897d4-97a1-4fbf-b39d-c052b53a5d04" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.097041] env[66919]: INFO networking_nsxv3.common.synchronization [req-36299735-ec97-462c-985e-7eacc289cf08 req-b34241f6-b70b-4f05-9813-dfbb319a4714 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 1112.097634] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGHEST for action security_group_members [ 1112.098212] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.098212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.098212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.098479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.098764] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.098933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.099109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.099363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.099499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.099624] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.195202] env[66919]: INFO networking_nsxv3.common.synchronization [req-5fdecdbe-b43a-43cb-9cbe-85b0bb377b92 req-80c51fb5-523d-4cd2-bb39-970caea4ecd0 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1112.195862] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 754aa366-08b4-46d7-a4e2-292d8016099c with Priority: HIGHEST for action security_group_members [ 1112.196124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-754aa366-08b4-46d7-a4e2-292d8016099c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.196271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.196313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.196584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.196750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.197017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.197017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.197116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.197163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.197255] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('754aa366-08b4-46d7-a4e2-292d8016099c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.549950] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.557445] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.601761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.604837] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.604837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.604837] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 is going to be updated. [ 1112.632859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.635031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.635031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.635031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.635031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.642259] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: IN_PROGRESS for 2s [ 1112.700782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.700996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.701096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.701313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.701413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.701614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.701709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.701772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.701924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.702034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.702156] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c is going to be updated. [ 1112.706969] env[66919]: INFO networking_nsxv3.common.synchronization [req-b24b909e-9ff4-476c-a2ba-22ccd9322b73 req-ebec2f22-3418-4e9b-836e-5e84cb96bf32 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1112.707767] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1112.708727] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.708893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.708982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.709205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.709559] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.709695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.709763] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.709978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.710105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.710216] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.736655] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.736816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.736858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.737095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.737280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.746965] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: IN_PROGRESS for 2s [ 1113.052036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.052036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.052036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.052338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.052338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.052435] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1113.060404] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.060537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.060606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.060800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.060884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.060976] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e is going to be created. [ 1113.082316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.082477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.082543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.082966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.082966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.084659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.084766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.084821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.084983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.085160] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.093943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1113.094573] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: UNINITIALIZED for 2s [ 1113.155725] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.155954] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.156091] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.156367] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.156716] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.156900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.157044] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.157266] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.157415] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.157617] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.157728] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1113.157835] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1113.157939] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1113.158058] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1113.158167] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1113.158294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1113.179556] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1113.179728] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1113.179868] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1113.180054] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-813" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.180373] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-2425c163-f870-42d1-9992-72d4ca6a68b6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.180547] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.180665] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.180985] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.181139] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2425c163-f870-42d1-9992-72d4ca6a68b6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.212800] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.212901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.212970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.213269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.213371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.213624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.213784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.213784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.213962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.214047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.214139] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1113.251321] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.251321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.251321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.251321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.251321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.268929] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1113.666513] env[66919]: INFO networking_nsxv3.common.synchronization [None req-8e17a0e6-0a44-4680-9bf2-0c7d6ccac6f5 None None] Enqueued Resource ID: 7b707736-4519-46cd-82d5-ba24ea5c515f with Priority: HIGHEST for action port [ 1113.667244] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b707736-4519-46cd-82d5-ba24ea5c515f with Priority: HIGHEST for action port [ 1113.667675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b707736-4519-46cd-82d5-ba24ea5c515f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.667854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b707736-4519-46cd-82d5-ba24ea5c515f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.667960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b707736-4519-46cd-82d5-ba24ea5c515f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.668329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b707736-4519-46cd-82d5-ba24ea5c515f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.668455] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b707736-4519-46cd-82d5-ba24ea5c515f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.683923] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.684274] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.684503] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.684873] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.685152] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.685398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 2425c163-f870-42d1-9992-72d4ca6a68b6 not found, creating... [ 1113.685794] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.686035] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.686212] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.686558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.686772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.687249] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.687498] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.687688] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.688105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.688228] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.688447] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 2425c163-f870-42d1-9992-72d4ca6a68b6 is going to be created. [ 1113.710982] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.711309] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.711491] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.711859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.712200] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.712509] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.170518] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b707736-4519-46cd-82d5-ba24ea5c515f [ 1114.170752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.170892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.170961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.171220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.171312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.171412] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b707736-4519-46cd-82d5-ba24ea5c515f already deleted. [ 1114.171497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b707736-4519-46cd-82d5-ba24ea5c515f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.654183] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 in Status: SUCCESS [ 1114.654547] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 deletion is rescheduled due to dependency. [ 1114.654658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.757575] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 754aa366-08b4-46d7-a4e2-292d8016099c in Status: SUCCESS [ 1114.757917] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 754aa366-08b4-46d7-a4e2-292d8016099c deletion is rescheduled due to dependency. [ 1114.757917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-754aa366-08b4-46d7-a4e2-292d8016099c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.916493] env[66919]: INFO networking_nsxv3.common.synchronization [req-b24b909e-9ff4-476c-a2ba-22ccd9322b73 req-b026fbeb-058a-4978-a3b5-0ace3f4cd78b service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1114.916493] env[66919]: INFO networking_nsxv3.common.synchronization [req-b24b909e-9ff4-476c-a2ba-22ccd9322b73 req-b026fbeb-058a-4978-a3b5-0ace3f4cd78b service nova] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1114.916493] env[66919]: INFO networking_nsxv3.common.synchronization [req-b24b909e-9ff4-476c-a2ba-22ccd9322b73 req-b026fbeb-058a-4978-a3b5-0ace3f4cd78b service nova] Enqueued Resource ID: 2425c163-f870-42d1-9992-72d4ca6a68b6 with Priority: HIGHEST for action port [ 1114.919794] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_rules [ 1114.920178] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1114.920378] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2425c163-f870-42d1-9992-72d4ca6a68b6 with Priority: HIGHEST for action port [ 1114.920787] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.922335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.922335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.922335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.922335] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.923439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.923439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.924425] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2425c163-f870-42d1-9992-72d4ca6a68b6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.924425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.924425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.924425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.924425] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2425c163-f870-42d1-9992-72d4ca6a68b6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.110097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: SUCCESS [ 1115.110833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.111380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.111739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.112109] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.112437] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.112625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.116019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.116019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.116019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.116019] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.116019] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1115.116823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.117395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.118438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.119085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.120027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.120027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.120027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.120027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.120027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.120027] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.280057] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1115.280057] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1115.280244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.280336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.280546] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.280736] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.280860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.280937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.281119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.281202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.281297] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.426187] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.426922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.427717] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2425c163-f870-42d1-9992-72d4ca6a68b6 with status ACTIVE [ 1115.427898] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.428024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.428089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.428307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.428375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.428984] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.428984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.428984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.428984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.429184] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.429568] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.429568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.429685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.430172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.430172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.430172] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2425c163-f870-42d1-9992-72d4ca6a68b6 is going to be updated. [ 1115.452389] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.452573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.452660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.454458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.454458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.454458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2425c163-f870-42d1-9992-72d4ca6a68b6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.622096] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.623276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.623480] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.623773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.624192] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.624594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.624740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.625212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.627020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.627020] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.627020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.627020] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.629914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.630845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.631024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.631767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.632053] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.633113] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.633113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.635015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.636751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.636751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.636751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.636751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.636751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.636751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.636751] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.696383] env[66919]: INFO networking_nsxv3.common.synchronization [req-7ce03bb5-8bcb-4548-945b-d99512c48a54 req-9a7de362-c216-46e5-9332-e5055531eef6 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1115.696383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1115.696752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.696864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.696934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.697683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.697683] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.697683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.697994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.697994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.698079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.698150] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.783351] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.098124] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.098124] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.098640] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.098855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.099311] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.099871] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.099871] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.100116] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.100409] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.100694] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.102107] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.102107] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.102107] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.102107] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.102107] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.102107] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.126262] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.126514] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.126635] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.126859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.127201] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-1a505571-00de-472f-9d83-0cb0e111d899 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.127440] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.127596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.128741] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.128741] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a505571-00de-472f-9d83-0cb0e111d899',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.137298] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e: rpc.has_security_group_logging(os_id): False [ 1116.141048] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8993b03-159d-4cb8-a490-873c724e7d28: rpc.has_security_group_logging(os_id): False [ 1116.158846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.158846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.158846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.158998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.159106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.159484] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.160045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.160045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.160045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.160260] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.160656] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.160832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.160946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.161275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.161426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.162027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.162027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.162158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.162390] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.163031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.163031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e is going to be created. [ 1116.165888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.166104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.166309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.166911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.167275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.167681] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.167843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.168073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.169036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.169036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.169036] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.169036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.169036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.169036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.169314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.169403] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.169503] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.169567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.169802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.169906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.169957] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1116.200239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.200513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.200513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.200769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.200878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.201150] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.201370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.201370] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.201566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.201632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.201693] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 already deleted. [ 1116.201769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.257914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.258154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.258269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.258559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.258824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.265027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.265233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.265317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.265537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.265677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.273020] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: IN_PROGRESS for 2s [ 1116.280910] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1116.285716] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.398343] env[66919]: INFO networking_nsxv3.common.synchronization [None req-1551f8d5-1fbe-4767-8789-d2fc0a5772ad None None] Enqueued Resource ID: b3f9bafc-ac75-4466-beb5-55cb75f3e08b with Priority: HIGHEST for action port [ 1116.399131] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3f9bafc-ac75-4466-beb5-55cb75f3e08b with Priority: HIGHEST for action port [ 1116.399859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3f9bafc-ac75-4466-beb5-55cb75f3e08b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.399936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3f9bafc-ac75-4466-beb5-55cb75f3e08b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.400348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3f9bafc-ac75-4466-beb5-55cb75f3e08b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.400444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3f9bafc-ac75-4466-beb5-55cb75f3e08b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.400555] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3f9bafc-ac75-4466-beb5-55cb75f3e08b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.632137] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.632437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.632970] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.633367] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.633695] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.633823] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 1a505571-00de-472f-9d83-0cb0e111d899 not found, creating... [ 1116.634165] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.634332] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.634450] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.634734] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.634923] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.635487] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.635761] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.635953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.636391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.636660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.636881] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 1a505571-00de-472f-9d83-0cb0e111d899 is going to be created. [ 1116.658356] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.658614] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.658743] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.659024] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.659242] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.659459] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.793525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.793525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.793525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.793525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.793525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.793525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1116.837158] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.837387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.837387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.837677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.837830] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.854722] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1116.902753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3f9bafc-ac75-4466-beb5-55cb75f3e08b [ 1116.902992] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.903142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.903211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.903429] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.903520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.903674] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3f9bafc-ac75-4466-beb5-55cb75f3e08b already deleted. [ 1116.903776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3f9bafc-ac75-4466-beb5-55cb75f3e08b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [req-7ce03bb5-8bcb-4548-945b-d99512c48a54 req-5e39ebb3-7fb4-421a-be32-9dbab3e61c2f service nova] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [req-7ce03bb5-8bcb-4548-945b-d99512c48a54 req-5e39ebb3-7fb4-421a-be32-9dbab3e61c2f service nova] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [req-7ce03bb5-8bcb-4548-945b-d99512c48a54 req-5e39ebb3-7fb4-421a-be32-9dbab3e61c2f service nova] Enqueued Resource ID: 1a505571-00de-472f-9d83-0cb0e111d899 with Priority: HIGHEST for action port [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1117.340941] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a505571-00de-472f-9d83-0cb0e111d899 with Priority: HIGHEST for action port [ 1117.340941] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.340941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.340941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.341759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.341974] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.343676] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.344548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.344548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.344548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.344548] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.344548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.344548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.345341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.346139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.346139] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.347022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a505571-00de-472f-9d83-0cb0e111d899 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.347022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.347022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.347022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.347022] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a505571-00de-472f-9d83-0cb0e111d899',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.853052] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.853052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.853052] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.853694] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a505571-00de-472f-9d83-0cb0e111d899 with status ACTIVE [ 1117.853753] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.853849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.853914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.855028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.855028] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.855028] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.855371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.855371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.855371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.855371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.855535] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a505571-00de-472f-9d83-0cb0e111d899 is going to be updated. [ 1117.880263] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.880417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.880493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.880706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.880846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.881190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.291402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: SUCCESS [ 1118.294497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.309331] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1118.309422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.358078] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.862317] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.862679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.862679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.862769] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.862871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.862975] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be created. [ 1118.866756] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1118.866968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.867140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.867345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.867530] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.867673] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.867729] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.867866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.867944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.868042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.868132] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.891914] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.892051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.892129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.892355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.892519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.929696] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: UNINITIALIZED for 2s [ 1119.370702] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.370868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.370944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.371193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.371373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.371481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.371577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.371704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.371796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.371885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.372049] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.372147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.372209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.372351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.372490] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.372652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.372788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.372943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.373181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.373302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.373469] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.878360] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2d1de849-c2e6-46e2-a774-597b77be599b: rpc.has_security_group_logging(os_id): False [ 1119.907447] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.907645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.907645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.907773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.907866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.908094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.908205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.908268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.908431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.908507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.908707] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.908803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.908864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.909030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.909115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.909293] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.909386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.909446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.909584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.909706] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.909755] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1119.987166] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.987395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.987496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.987926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.988518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.004097] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1120.940067] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: SUCCESS [ 1120.940345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.941019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.941019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.941019] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.941019] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.941461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.941461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.941461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.941461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.941461] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.444409] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.947344] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49750f4-d44e-4a2c-9149-0e26c8f444f0: rpc.has_security_group_logging(os_id): False [ 1121.971081] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.971230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.971326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.971610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.971683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.972014] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.972132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.972201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.972354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.972446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.972518] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be created. [ 1122.019639] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1122.019973] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.045332] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.045565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.045682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.046037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.046350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.061439] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: IN_PROGRESS for 2s [ 1122.340918] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1122.340918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1122.880740] env[66919]: INFO networking_nsxv3.common.synchronization [req-7d28d510-e590-493a-ad93-008a40326892 req-429feeeb-01bc-4322-bcb8-48f91dc32340 tempest-ServerPasswordTestJSON-248770221 tempest-ServerPasswordTestJSON-248770221-project-member] Enqueued Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1122.881455] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGHEST for action security_group_members [ 1122.881829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.883421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.883692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.883801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.884179] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.884254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.884287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.884803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.884896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.884994] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.390341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.390341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.390341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.390341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.390341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.390341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.390824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.390824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.390824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.390824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.390824] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e is going to be updated. [ 1123.421660] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.421805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.421890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.422131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.422275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.431859] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: IN_PROGRESS for 2s [ 1124.083326] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: SUCCESS [ 1124.083326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.445858] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e in Status: SUCCESS [ 1125.446236] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e deletion is rescheduled due to dependency. [ 1125.446236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.882581] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.882851] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1128.709217] env[66919]: INFO networking_nsxv3.common.synchronization [req-3f462fa6-ec96-4068-a07e-3e052d4bfa3e req-448c9f0a-7c74-4f37-8b9d-14b0b3e1fae3 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1128.709217] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1128.709217] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.709217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.709217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.710233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.710459] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.710616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.710697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.710892] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.711012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.711127] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.213151] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.716424] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.828255] env[66919]: INFO networking_nsxv3.common.synchronization [req-51694d73-e881-45ef-9a3f-e957d2a1c18b req-79cd3230-984d-4507-b26d-4b97ef774502 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1129.828705] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1129.829022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.829140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.829287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.829500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.829675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.829831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.829831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.829978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.830743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.830743] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.219751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.219751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.219751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.220027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.220027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.220027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be updated. [ 1130.225346] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-569 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.228416] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.228491] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.228721] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.228997] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.229168] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.229280] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.229492] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.229626] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.229827] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.229931] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.230045] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.230607] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.230607] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.230607] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.230607] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.250234] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.250408] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.250543] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.250721] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-569" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.251044] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-20474efa-ae1b-4f94-abbd-2f498f201485 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.251204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.251322] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.251657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.251794] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20474efa-ae1b-4f94-abbd-2f498f201485',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.263640] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.263783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.263861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.264065] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.264214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.276508] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1130.331737] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.754471] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.754860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.755105] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.755529] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.755772] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.756025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 20474efa-ae1b-4f94-abbd-2f498f201485 not found, creating... [ 1130.756436] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.756661] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.756824] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.757303] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.757598] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.758167] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.758437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.758638] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.758958] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.759198] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.759500] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 20474efa-ae1b-4f94-abbd-2f498f201485 is going to be created. [ 1130.782549] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.782767] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.782887] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.783195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.783431] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.783652] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.833743] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.336437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.336753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.336753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.337469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.337469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.337469] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1131.372429] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.372581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.372641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.372873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.372995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.385365] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [req-51694d73-e881-45ef-9a3f-e957d2a1c18b req-2ecd7e16-88c6-4814-b090-e364856eee9a service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [req-51694d73-e881-45ef-9a3f-e957d2a1c18b req-2ecd7e16-88c6-4814-b090-e364856eee9a service nova] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [req-51694d73-e881-45ef-9a3f-e957d2a1c18b req-2ecd7e16-88c6-4814-b090-e364856eee9a service nova] Enqueued Resource ID: 20474efa-ae1b-4f94-abbd-2f498f201485 with Priority: HIGHEST for action port [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_rules [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1131.495216] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20474efa-ae1b-4f94-abbd-2f498f201485 with Priority: HIGHEST for action port [ 1131.496700] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.498471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.498471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.498471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.498471] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.498836] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.498836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.498977] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-20474efa-ae1b-4f94-abbd-2f498f201485 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.499195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.499195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.502531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.502531] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20474efa-ae1b-4f94-abbd-2f498f201485',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.002700] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.002700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.005071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20474efa-ae1b-4f94-abbd-2f498f201485 with status ACTIVE [ 1132.005260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.005375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.005438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.005640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.006942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.006942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.006942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.006942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20474efa-ae1b-4f94-abbd-2f498f201485 is going to be updated. [ 1132.030982] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.030982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.030982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.031416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.031416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.031622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20474efa-ae1b-4f94-abbd-2f498f201485" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.258323] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-43bd08aa-0888-4ca7-852b-bbbd33701654 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1132.259202] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1132.259331] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.259422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.259545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.259747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.259926] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.260017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.260104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.260283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.260316] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.260421] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.319044] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1132.319179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.601030] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.601356] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.601464] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.602683] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.602683] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.602856] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.603026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.603306] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.603748] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.603822] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.604249] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.604249] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.604249] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.604978] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.604978] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.604978] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.625262] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.625433] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.625569] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.625750] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.626112] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-fcacff74-e970-44d1-8736-46192ee687a7 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.626276] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.626363] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.626664] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.626802] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcacff74-e970-44d1-8736-46192ee687a7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.762300] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.762481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.762526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.762967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.762967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.763123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.763366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.763482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.763667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.763805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.763865] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 already deleted. [ 1132.763967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.130710] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.130947] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.131079] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.131357] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.131507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.131659] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port fcacff74-e970-44d1-8736-46192ee687a7 not found, creating... [ 1133.131914] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.132083] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.132203] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.132437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.132607] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.132893] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.133057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.133171] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.133372] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.133508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.133645] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: fcacff74-e970-44d1-8736-46192ee687a7 is going to be created. [ 1133.158587] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.158861] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.158981] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.159269] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.159519] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.159734] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.400497] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1133.400846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.401176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.401527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.401792] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.401983] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.402391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.402719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.402909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.403124] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.905975] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-621ddda0-490b-46d0-b68f-da5547b87c8d service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-621ddda0-490b-46d0-b68f-da5547b87c8d service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-621ddda0-490b-46d0-b68f-da5547b87c8d service nova] Enqueued Resource ID: fcacff74-e970-44d1-8736-46192ee687a7 with Priority: HIGHEST for action port [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1133.966341] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcacff74-e970-44d1-8736-46192ee687a7 with Priority: HIGHEST for action port [ 1133.966341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.966341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.967248] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.967636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.968010] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.970310] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.970572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.970728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.971827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.971827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.971827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.971827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.971827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.971827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.971827] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.975564] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-fcacff74-e970-44d1-8736-46192ee687a7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.975564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.975564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.975564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.975564] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fcacff74-e970-44d1-8736-46192ee687a7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.408296] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.481898] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.483012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.483196] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.483308] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fcacff74-e970-44d1-8736-46192ee687a7 with status ACTIVE [ 1134.483464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.483594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.483666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.483880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.483963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.484163] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.484272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.484337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.484515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.484584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.484765] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.484856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.484933] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.485560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.485684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.485740] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fcacff74-e970-44d1-8736-46192ee687a7 is going to be updated. [ 1134.512070] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.512336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.512336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.512560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.512669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.512894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fcacff74-e970-44d1-8736-46192ee687a7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.910435] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.910805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.910805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.911134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.911254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.911426] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1134.938116] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.938321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.938385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.938603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.938746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.950394] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1134.988621] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.259154] env[66919]: INFO networking_nsxv3.common.synchronization [req-fa963a8e-97d9-4a88-847c-9d6c97e93c16 req-2dbc1a8e-a0bb-4680-93c2-710fa54a49dc tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 1135.259724] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGHEST for action security_group_members [ 1135.260037] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.260166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.260231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.260428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.260576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.260695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.260755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.260904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.260986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.261091] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.492094] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.492252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.492323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.492533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.492621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.492719] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be created. [ 1135.521578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.521761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.521802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.521981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.522315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.533641] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: UNINITIALIZED for 2s [ 1135.764687] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.764787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.764824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.765102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.786667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.787035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.787246] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.787545] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.787757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.787842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.787939] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da753667-590d-44b7-b73e-76baaab11b84 is going to be updated. [ 1135.818225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.818395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.818517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.818791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.818856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.829156] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: IN_PROGRESS for 2s [ 1135.867133] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-c3e1b664-668d-43e3-9b6d-5d929b856d84 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1135.867133] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1135.867133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.867133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.250546] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.250962] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.250962] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.251360] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.251736] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.252224] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.252224] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.252427] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.252618] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.252883] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.253034] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1136.253212] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1136.253350] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1136.254035] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1136.254035] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1136.254198] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1136.287624] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1136.287811] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1136.287948] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1136.288627] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.288762] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-2984f74c-ce12-44df-af11-a7b20a06ccf9 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.288885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.289078] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.290631] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.290785] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2984f74c-ce12-44df-af11-a7b20a06ccf9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.793830] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.794066] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.794196] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.794469] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.794619] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.794772] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 2984f74c-ce12-44df-af11-a7b20a06ccf9 not found, creating... [ 1136.795076] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.795222] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.795346] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.796023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.796023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.796023] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.796210] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.796254] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.796453] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.796745] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.796745] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 2984f74c-ce12-44df-af11-a7b20a06ccf9 is going to be created. [ 1136.817405] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.817577] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.818265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.818265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.818507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.818859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.961961] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1136.962268] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.962528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.963163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.963163] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.963163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.963163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.963507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.963507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.963575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.963618] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.467782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.467782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.467782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.467782] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.468817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.468817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.470023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.470023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.470797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.471081] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.471790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.471790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.471790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.471790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.471790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.471790] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.511531] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-0ba39108-be2f-4933-8ade-1dd50c34c564 service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1137.511531] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-0ba39108-be2f-4933-8ade-1dd50c34c564 service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1137.511531] env[66919]: INFO networking_nsxv3.common.synchronization [req-80cb92e1-32a8-45d8-9804-d224fab806a7 req-0ba39108-be2f-4933-8ade-1dd50c34c564 service nova] Enqueued Resource ID: 2984f74c-ce12-44df-af11-a7b20a06ccf9 with Priority: HIGHEST for action port [ 1137.511531] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1137.511531] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1137.512314] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2984f74c-ce12-44df-af11-a7b20a06ccf9 with Priority: HIGHEST for action port [ 1137.512736] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.512954] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.513846] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.513846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.513993] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-2984f74c-ce12-44df-af11-a7b20a06ccf9 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.514798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.514875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.515126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.515247] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2984f74c-ce12-44df-af11-a7b20a06ccf9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.547533] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1137.547913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.549091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.549325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.549519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.549647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.549711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.549862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.551041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.551742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.551902] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.553292] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.553484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.553719] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.553840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.553906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.557334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.557498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.557640] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.839953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da753667-590d-44b7-b73e-76baaab11b84 in Status: SUCCESS [ 1137.840160] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da753667-590d-44b7-b73e-76baaab11b84 deletion is rescheduled due to dependency. [ 1137.840279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.980049] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 126dbb86-4151-4c70-bb98-79a6ebd8d9c5: rpc.has_security_group_logging(os_id): False [ 1138.003035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.003035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.003035] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.003035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.003620] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.003620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.003620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.003620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.003620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.003808] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1138.020031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2984f74c-ce12-44df-af11-a7b20a06ccf9 with status ACTIVE [ 1138.020031] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.020031] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.020031] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.020031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.020031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2984f74c-ce12-44df-af11-a7b20a06ccf9 is going to be updated. [ 1138.048745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.048745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.048745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.048745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.048745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.048745] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2984f74c-ce12-44df-af11-a7b20a06ccf9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.060311] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.060311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.060311] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.091410] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.091410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.091410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.091410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.091410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.124924] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1138.562152] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.065230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.065444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.065529] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.065774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.065871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.065974] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1139.102051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.102051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.102051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.102320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.105076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.115034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1140.139841] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1140.140229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.126290] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1141.126508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.126979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.126979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.127202] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.127287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.127372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.127539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.127622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.127720] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.630247] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.132467] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.144110] env[66919]: INFO networking_nsxv3.common.synchronization [req-419bf807-2d95-4901-bef5-e0dffe0e12ac req-c91dd620-e4c6-48b9-84d6-d0bd2a509683 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1142.144110] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1142.144592] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.144592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.144592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.144823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.144932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.144932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.145041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.145464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.145559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.145657] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.498514] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.498717] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.498828] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.499118] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.499383] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.499758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.499758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.499904] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.500060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.500275] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.500390] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1142.500492] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1142.500647] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1142.500805] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1142.500937] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1142.501084] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1142.527997] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1142.528172] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1142.528316] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1142.528529] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.528856] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.529046] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.529165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.531770] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.531906] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.635885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.635885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.635885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.635885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.635885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.635885] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1142.648526] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.648697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.648736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.648916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.664986] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.665284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.665284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.665444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.665551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.668326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.668566] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.668680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.668762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.668924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.669041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.669130] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be updated. [ 1142.677741] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1142.693693] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.693836] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.693905] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.694132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.694270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.703447] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 1143.034810] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.034968] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.035211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.035657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.035827] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.036048] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 not found, creating... [ 1143.036396] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.036596] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.036762] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.037054] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.037346] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.037639] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.038915] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.038915] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.038915] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.038915] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.038915] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 is going to be created. [ 1143.064478] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.064707] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.064830] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.065156] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.065525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.065802] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.775080] env[66919]: INFO networking_nsxv3.common.synchronization [req-419bf807-2d95-4901-bef5-e0dffe0e12ac req-c2031460-d00f-44e0-b08b-d0e62c711c36 service nova] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_rules [ 1143.775438] env[66919]: INFO networking_nsxv3.common.synchronization [req-419bf807-2d95-4901-bef5-e0dffe0e12ac req-c2031460-d00f-44e0-b08b-d0e62c711c36 service nova] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1143.775438] env[66919]: INFO networking_nsxv3.common.synchronization [req-419bf807-2d95-4901-bef5-e0dffe0e12ac req-c2031460-d00f-44e0-b08b-d0e62c711c36 service nova] Enqueued Resource ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with Priority: HIGHEST for action port [ 1143.775918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_rules [ 1143.776105] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1143.776211] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with Priority: HIGHEST for action port [ 1143.776485] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.776606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.776675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.776869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.776957] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.777850] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.777968] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.778142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.779266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.779324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.779519] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.779636] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.281696] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.281828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.281942] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with status ACTIVE [ 1144.282133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.282243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.282311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.282537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.282635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.282849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.282989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.283072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.283257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.283379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.283545] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.283621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.283728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.283825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.283901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.283990] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 is going to be updated. [ 1144.307863] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.308012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.308093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.308306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.308500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.308672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.688403] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1144.688628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.688795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.689029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.689226] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.689368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.689434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.689619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.689731] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.689822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.689980] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.690092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.690146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.690290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.690428] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.690540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.690601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.690736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.690808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.690886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.690975] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.712411] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 1144.712411] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 deletion is rescheduled due to dependency. [ 1144.712518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.712942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.713727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.713727] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.713727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.713727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.714040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.714040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.714040] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.194706] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365f0d7e-3740-4616-bfcb-3bab286dfb33: rpc.has_security_group_logging(os_id): False [ 1145.212274] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.212408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.212483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.212742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.212838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.213072] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.213178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.213242] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.213401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.213478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.213750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.213851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.213913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.214066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.214140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.214316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.214409] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.214469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.214606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.214678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.214762] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be created. [ 1145.215866] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.276632] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.276632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.276632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.276632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.276632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.288253] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1145.718322] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.221133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.221532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.221532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.221599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.221688] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.221781] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be updated. [ 1146.252626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.252812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.252949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.253058] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.253421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.263107] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 1146.679996] env[66919]: INFO networking_nsxv3.common.synchronization [req-9a7f9918-358c-4db9-b7a8-e8257db75451 req-440400c7-a297-4d4d-a818-72406fbbfad7 tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1146.679996] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1146.679996] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.679996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.679996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.680251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.680325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.680494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.680494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.680595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.680679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.680807] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.988230] env[66919]: INFO networking_nsxv3.common.synchronization [req-8f9cb50e-c20f-410e-bc2b-6a8d07491057 req-2152bb6d-8225-471d-bd2c-e7ffbd1bc22a tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1146.989043] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGHEST for action security_group_members [ 1146.989141] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.989238] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.989304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.989516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.989675] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.989778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.989833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.989980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.990082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.990174] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.039434] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fd2ed32e-cf36-41c7-bb81-b7dab5a32679 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1147.040114] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1147.040444] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.040753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.040753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.040906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.040952] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.132415] env[66919]: INFO networking_nsxv3.common.synchronization [None req-9a5face7-5aa4-45e8-a54e-88dd24e34c43 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1147.133780] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1147.133780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.133780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.182957] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.303021] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1147.303021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.303021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.303021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.303021] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.492478] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.492739] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.492850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.493125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.493262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.493493] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.493666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.493766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.493955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.494077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.494197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be updated. [ 1147.522060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.522060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.522060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.522060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.522060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.530342] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: IN_PROGRESS for 2s [ 1147.564447] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.564447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.564447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.564447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.564711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.564711] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 already deleted. [ 1147.564851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.565334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.566104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.566984] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.684867] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.807392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.807612] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.807677] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.807923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.808107] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.808208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.808269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.808573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.808669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.809074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.809254] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.090645] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.090791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.090863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.091100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.091199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.091398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 already deleted. [ 1148.091487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.187230] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.187505] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.187599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.187832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.187931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.188045] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1148.225561] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.225742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.225812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.226041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.226189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.236238] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1148.274744] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 1148.276373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.276373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.276373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.276373] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.276373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.276373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.276710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.276710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.276710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.276710] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.312311] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.312311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.314222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.314222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.314222] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.314886] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.314886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.315247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.315247] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.782060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.782060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.782060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.782060] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.782060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.782748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.782748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.782748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.782748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.782748] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.818028] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365f0d7e-3740-4616-bfcb-3bab286dfb33: rpc.has_security_group_logging(os_id): False [ 1148.836887] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.837097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.837180] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.837558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.837699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.837947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.838139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.838139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.838848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.838848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.838848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.838848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.838848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.839135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.839217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.839378] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.839461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.839523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.839667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.839740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.839890] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1148.911265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.911265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.911438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.911539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.911740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.939228] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1149.285332] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8de9ea36-57e3-4c37-a587-59d118b05d81: rpc.has_security_group_logging(os_id): False [ 1149.311878] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.311878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.311878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.312164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.312346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.312664] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.312664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.312777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.312935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.313122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.313325] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.313447] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.313536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.313734] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.313827] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.314061] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.314386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.314386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.314468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.314583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.314643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be updated. [ 1149.396066] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.396066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.396287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.396430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.396515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.416828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 1149.545323] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 in Status: SUCCESS [ 1149.545604] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 deletion is rescheduled due to dependency. [ 1149.545685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.821320] env[66919]: INFO networking_nsxv3.common.synchronization [req-60a6185e-336c-4a5b-a141-6b183bfb24f9 req-5c890381-f120-4980-b606-a6320a0410c6 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1149.821807] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1149.823637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.823637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.823637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.823637] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.037369] env[66919]: INFO networking_nsxv3.common.synchronization [req-9a3a2735-295e-4137-b763-be121c640c2f req-ee25cefc-5ae6-4540-9031-cb28fb333901 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1150.037951] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1150.038277] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.038380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.247050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1150.247216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.326089] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.829128] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.959318] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1150.959598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.332454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.332768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.332768] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.333073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.333229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.333373] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1151.360067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.360217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.360280] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.360492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.360635] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.370350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1151.431852] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 1151.431852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.828851] env[66919]: INFO networking_nsxv3.common.synchronization [req-7b433a0f-c8a7-4d7f-bdd7-568f28fa261a req-f22093dc-23c6-4522-b4ec-ac0145c76f89 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1151.829420] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGHEST for action security_group_members [ 1151.829724] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.829878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.829946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.830156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.830321] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.830411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.830475] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.830643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.830771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.830872] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.872780] env[66919]: INFO networking_nsxv3.common.synchronization [req-7b433a0f-c8a7-4d7f-bdd7-568f28fa261a req-f22093dc-23c6-4522-b4ec-ac0145c76f89 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with Priority: HIGHEST for action port [ 1151.873481] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with Priority: HIGHEST for action port [ 1151.873780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.873899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.874412] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.874491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.874818] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.334027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.334027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.334027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.334589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.334589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.334689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.334966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.334966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.335173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.335265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.335410] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be updated. [ 1152.366480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.366846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.366972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.367267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.367424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.378907] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: IN_PROGRESS for 2s [ 1152.379192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 with status ACTIVE [ 1152.379361] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.379491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.379561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.379861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.380036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.380186] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.380273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.380323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.380574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.380661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.380849] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.380947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.381020] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.381163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.381236] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.381321] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7 is going to be updated. [ 1152.452470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.452656] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.452695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.452902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.454092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.454092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35b4b6b9-5240-4fcd-a29f-f7c64a0de1b7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.380980] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1153.381498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.381498] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.381644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.381780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.381895] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.381955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.382090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.382162] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.382260] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.886314] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.886314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.886432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.886813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.886981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.887932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.887932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.887932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.887932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.887932] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.887932] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1153.922470] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.922470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.922470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.922470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.922470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.932423] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1154.390661] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 in Status: SUCCESS [ 1154.391015] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 deletion is rescheduled due to dependency. [ 1154.391015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.945065] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1155.945065] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 deletion is rescheduled due to dependency. [ 1155.945464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.221384] env[66919]: INFO networking_nsxv3.common.synchronization [None req-30e1ffdc-e6c1-4b18-9414-c99abb085640 tempest-AttachInterfacesTestJSON-624819323 tempest-AttachInterfacesTestJSON-624819323-project-member] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1156.222397] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGHEST for action security_group_members [ 1156.223047] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.223175] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.223255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.224090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.224090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.224090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.224090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.224090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.224417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.224417] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.726430] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.726638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.726691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.727022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.727171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.727442] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.727582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.727644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.727887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.727988] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.728091] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be updated. [ 1156.766818] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.766986] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.767172] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.767298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.767438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.781415] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: IN_PROGRESS for 2s [ 1158.793297] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8993b03-159d-4cb8-a490-873c724e7d28 in Status: SUCCESS [ 1158.793628] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 deletion is rescheduled due to dependency. [ 1158.793628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.919240] env[66919]: INFO networking_nsxv3.common.synchronization [req-80e219da-2099-4356-bd03-9c95319593a0 req-1eb80471-a025-4f0e-99ba-ed4d0e1fbb4c tempest-ServersTestJSON-1217461178 tempest-ServersTestJSON-1217461178-project-member] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1158.919240] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGHEST for action security_group_members [ 1158.919679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.919679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.921145] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.921145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.921145] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.423559] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.423733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.423784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.425553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.425553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.425553] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be updated. [ 1159.455120] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.455277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.455346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.455563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.455796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.466984] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: IN_PROGRESS for 2s [ 1159.535075] env[66919]: INFO networking_nsxv3.common.synchronization [req-c2e80a54-92c5-4df0-908e-7ce3f8e273bc req-743ee3a8-a883-49da-a282-e183efee9744 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1159.535683] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1159.535921] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.536330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.536423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.536681] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.536838] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.536944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.537015] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.537171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.537256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.537347] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.934139] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.934139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.934139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.936862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.936862] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.936862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.936862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.936862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.936862] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.936862] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.936862] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.936862] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.936862] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.936862] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.936862] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.936862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.959832] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.960086] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.961065] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.961065] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.961065] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-8f7776cd-0cb6-48b5-83ba-ede03403898e taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.961065] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.961065] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.961452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.961452] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f7776cd-0cb6-48b5-83ba-ede03403898e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.040140] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.040335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.040335] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.040639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.040639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.040817] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.040963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.041066] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.041245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.041348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.041445] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 already deleted. [ 1160.041528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.464318] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.464437] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.464510] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.464899] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.465083] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.465267] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 8f7776cd-0cb6-48b5-83ba-ede03403898e not found, creating... [ 1160.465617] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.465825] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.465956] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.466907] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.467182] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.467587] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.467868] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.468202] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.468566] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.468832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.469152] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 8f7776cd-0cb6-48b5-83ba-ede03403898e is going to be created. [ 1160.494976] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.494976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.494976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.494976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.494976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.494976] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.236468] env[66919]: INFO networking_nsxv3.common.synchronization [req-c2e80a54-92c5-4df0-908e-7ce3f8e273bc req-6c349917-7467-45a8-a1cf-24d75ba03818 service nova] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1161.236826] env[66919]: INFO networking_nsxv3.common.synchronization [req-c2e80a54-92c5-4df0-908e-7ce3f8e273bc req-6c349917-7467-45a8-a1cf-24d75ba03818 service nova] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1161.236947] env[66919]: INFO networking_nsxv3.common.synchronization [req-c2e80a54-92c5-4df0-908e-7ce3f8e273bc req-6c349917-7467-45a8-a1cf-24d75ba03818 service nova] Enqueued Resource ID: 8f7776cd-0cb6-48b5-83ba-ede03403898e with Priority: HIGHEST for action port [ 1161.238346] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_rules [ 1161.238525] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1161.238638] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f7776cd-0cb6-48b5-83ba-ede03403898e with Priority: HIGHEST for action port [ 1161.241953] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.241953] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.241953] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.241953] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.241953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.241953] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.242650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f7776cd-0cb6-48b5-83ba-ede03403898e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.242738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.242773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.242891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.242962] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f7776cd-0cb6-48b5-83ba-ede03403898e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.477949] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 in Status: SUCCESS [ 1161.477949] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 deletion is rescheduled due to dependency. [ 1161.477949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.545215] env[66919]: INFO networking_nsxv3.common.synchronization [None req-03d44a68-153e-400b-b6d9-dd03cbea1718 None None] Enqueued Resource ID: 47f01313-9ad8-4a0a-9732-2be8721802e7 with Priority: HIGHEST for action port [ 1161.545777] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f01313-9ad8-4a0a-9732-2be8721802e7 with Priority: HIGHEST for action port [ 1161.546105] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f01313-9ad8-4a0a-9732-2be8721802e7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.546227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f01313-9ad8-4a0a-9732-2be8721802e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.546295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f01313-9ad8-4a0a-9732-2be8721802e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.546685] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f01313-9ad8-4a0a-9732-2be8721802e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.546795] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f01313-9ad8-4a0a-9732-2be8721802e7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.745113] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.746433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.746590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.747663] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f7776cd-0cb6-48b5-83ba-ede03403898e with status ACTIVE [ 1161.748591] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.748591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.748591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.748887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.748887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.749163] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.749163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.749163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.749287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.750074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.750074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.750074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.750074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.750074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.750357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.750586] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f7776cd-0cb6-48b5-83ba-ede03403898e is going to be updated. [ 1161.777168] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.777168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.777168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.777168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.777168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.777168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f7776cd-0cb6-48b5-83ba-ede03403898e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.806164] env[66919]: INFO networking_nsxv3.common.synchronization [req-729ee425-9991-44f1-8088-829fa4cd4e23 req-b2489814-f211-43c5-a732-526873d5cbbd tempest-ServersTestBootFromVolume-1784369835 tempest-ServersTestBootFromVolume-1784369835-project-member] Enqueued Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1161.806681] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f65ecefc-2215-4da9-a836-c6bf34b8534e with Priority: HIGHEST for action security_group_members [ 1161.806973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f65ecefc-2215-4da9-a836-c6bf34b8534e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.809858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.809947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.810201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.810398] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.810507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.810579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.810736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.810843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.810941] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f65ecefc-2215-4da9-a836-c6bf34b8534e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.050349] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47f01313-9ad8-4a0a-9732-2be8721802e7 [ 1162.050349] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.050349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.050349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.050349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.050349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.050349] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47f01313-9ad8-4a0a-9732-2be8721802e7 already deleted. [ 1162.050349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f01313-9ad8-4a0a-9732-2be8721802e7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.253513] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.314720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.314903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.315030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.315232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.315342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.315735] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.315735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.315735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.315982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.315982] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.316114] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e is going to be updated. [ 1162.350000] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.350254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.350309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.350551] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.352125] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.361504] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: IN_PROGRESS for 2s [ 1162.755811] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.755999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.756092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.756285] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.756373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.756477] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 is going to be created. [ 1162.783562] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.783732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.783732] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.783947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.784170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.794064] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: UNINITIALIZED for 2s [ 1164.026477] env[66919]: INFO networking_nsxv3.common.synchronization [None req-0d5f4f95-616a-464e-bf87-d759e03df692 None None] Enqueued Resource ID: 87e45a8f-5729-48d1-ab41-ed279b22ee71 with Priority: HIGHEST for action port [ 1164.027357] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87e45a8f-5729-48d1-ab41-ed279b22ee71 with Priority: HIGHEST for action port [ 1164.028079] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-87e45a8f-5729-48d1-ab41-ed279b22ee71 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.028233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87e45a8f-5729-48d1-ab41-ed279b22ee71" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.028305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87e45a8f-5729-48d1-ab41-ed279b22ee71" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.028574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87e45a8f-5729-48d1-ab41-ed279b22ee71" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.028963] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87e45a8f-5729-48d1-ab41-ed279b22ee71',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.373500] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f65ecefc-2215-4da9-a836-c6bf34b8534e in Status: SUCCESS [ 1164.373500] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f65ecefc-2215-4da9-a836-c6bf34b8534e deletion is rescheduled due to dependency. [ 1164.373665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f65ecefc-2215-4da9-a836-c6bf34b8534e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.531489] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87e45a8f-5729-48d1-ab41-ed279b22ee71 [ 1164.531750] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.531885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.531946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.532183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.532270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.532363] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87e45a8f-5729-48d1-ab41-ed279b22ee71 already deleted. [ 1164.532442] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87e45a8f-5729-48d1-ab41-ed279b22ee71" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.805111] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: SUCCESS [ 1164.805111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.805111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.805343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.806103] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.806103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.806103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.806103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.806103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.806103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.806103] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.309337] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.812269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4e84c14-8146-4c6a-8c3b-882ddeeb1f72: rpc.has_security_group_logging(os_id): False [ 1165.832803] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.833100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.833100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.833315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.833419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.833679] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.833812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.833871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.834023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.834120] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.834192] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 is going to be created. [ 1165.899348] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.899634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.899742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.900106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.900371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.911144] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: IN_PROGRESS for 2s [ 1167.927063] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: SUCCESS [ 1167.927305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.029461] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1169.029861] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1169.496908] env[66919]: INFO networking_nsxv3.common.synchronization [req-5d8ade44-58e7-420f-92bf-d8e5fa995477 req-917545e9-ef9d-47cd-bb89-4e8f762e499d tempest-AttachVolumeTestJSON-1317127274 tempest-AttachVolumeTestJSON-1317127274-project-member] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1169.497439] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGHEST for action security_group_members [ 1169.497777] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.497899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.497980] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.498307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.498469] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.498569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.498637] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.498797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.498922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.499067] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.003624] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.004046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.004176] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.004417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.004506] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.004724] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.005045] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.005144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.005581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.005686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.005774] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 is going to be updated. [ 1170.044575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.044575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.045038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.045038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.045038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.060513] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: IN_PROGRESS for 2s [ 1170.860173] env[66919]: INFO networking_nsxv3.common.synchronization [req-fe57a990-ab4e-4e62-920a-a2d330fdbdeb req-5b8a2dc1-a654-4dc1-b8d4-8edeec201143 tempest-DeleteServersTestJSON-2000159148 tempest-DeleteServersTestJSON-2000159148-project-member] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1170.860173] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGHEST for action security_group_members [ 1170.860173] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.860345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.860345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.860485] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.861978] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.861978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.861978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.861978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.861978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.861978] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.363389] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.363791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.363791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.363902] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.364034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.364487] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.364487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.364487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.364639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.364639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.364712] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be updated. [ 1171.392354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.392354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.392354] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.392542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.393047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.402788] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: IN_PROGRESS for 2s [ 1172.072337] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 in Status: SUCCESS [ 1172.073439] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 deletion is rescheduled due to dependency. [ 1172.073439] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.413891] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2d1de849-c2e6-46e2-a774-597b77be599b in Status: SUCCESS [ 1173.414205] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b deletion is rescheduled due to dependency. [ 1173.414205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.410968] env[66919]: INFO networking_nsxv3.common.synchronization [req-4e1d052a-1bc8-433b-a80f-5b0b12f365d9 req-d1f3aefd-6988-4f4a-903a-dee3400f6988 tempest-InstanceActionsTestJSON-414303718 tempest-InstanceActionsTestJSON-414303718-project-member] Enqueued Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1175.411510] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1175.411824] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.411945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.412030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.412311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.412521] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.412703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.412703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.412854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.412936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.413052] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.788531] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-804 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.788848] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-804" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.789351] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-804" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.789714] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-804" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.789989] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.790168] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.790366] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.790642] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.790842] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.791077] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.791353] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1175.791467] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1175.791574] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1175.791684] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1175.791786] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1175.791921] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1175.812421] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1175.812693] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1175.812903] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1175.813121] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-804" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.813471] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.813688] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.813872] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.814199] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.814341] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d1e6842-a7a1-4096-8383-b3bef3b7edb9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.914751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.914900] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.914962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.915202] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.915293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.915489] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.915580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.915638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.915787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.915859] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.915943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f already deleted. [ 1175.916033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.317260] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.317677] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.317751] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.318056] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.318262] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.318467] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 not found, creating... [ 1176.318768] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.318900] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.319101] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.319346] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.319513] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.319837] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.319982] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.320167] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.320466] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.321097] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.321311] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 is going to be created. [ 1176.346469] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.346690] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.346815] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.347527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.347781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.348007] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.538927] env[66919]: INFO networking_nsxv3.common.synchronization [req-4e1d052a-1bc8-433b-a80f-5b0b12f365d9 req-8763aac8-baa0-4882-bfc5-30e80b31b4d1 service nova] Enqueued Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_rules [ 1177.539298] env[66919]: INFO networking_nsxv3.common.synchronization [req-4e1d052a-1bc8-433b-a80f-5b0b12f365d9 req-8763aac8-baa0-4882-bfc5-30e80b31b4d1 service nova] Enqueued Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1177.539357] env[66919]: INFO networking_nsxv3.common.synchronization [req-4e1d052a-1bc8-433b-a80f-5b0b12f365d9 req-8763aac8-baa0-4882-bfc5-30e80b31b4d1 service nova] Enqueued Resource ID: 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 with Priority: HIGHEST for action port [ 1177.539925] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_rules [ 1177.540135] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1177.540271] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 with Priority: HIGHEST for action port [ 1177.540608] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.540764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.540856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.541206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.541384] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.544531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.544531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.544531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.544531] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.544531] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.545682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.545682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.545856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.546120] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d1e6842-a7a1-4096-8383-b3bef3b7edb9',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.741196] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c618e33a-6cff-4248-8c99-f994008d0089 None None] Enqueued Resource ID: de80360b-f277-4a6f-8518-9e95e7c18be3 with Priority: HIGHEST for action port [ 1177.742025] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de80360b-f277-4a6f-8518-9e95e7c18be3 with Priority: HIGHEST for action port [ 1177.742025] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-de80360b-f277-4a6f-8518-9e95e7c18be3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.742025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de80360b-f277-4a6f-8518-9e95e7c18be3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.742025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de80360b-f277-4a6f-8518-9e95e7c18be3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.742684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de80360b-f277-4a6f-8518-9e95e7c18be3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.742788] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de80360b-f277-4a6f-8518-9e95e7c18be3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.036156] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-e0c812bf-790b-45dc-a45a-973e10dc1247 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1178.037063] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1178.038420] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.039334] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.039334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.039626] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.039626] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.048159] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.049133] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.049253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.049408] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 with status ACTIVE [ 1178.049563] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.049671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.049737] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.049937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.050047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.050237] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.050338] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.050393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.050868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.050868] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.050987] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.051070] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.051274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.052170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.052170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.052170] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d1e6842-a7a1-4096-8383-b3bef3b7edb9 is going to be updated. [ 1178.073935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.074109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.074153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.074430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.074567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.074725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d1e6842-a7a1-4096-8383-b3bef3b7edb9" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.246040] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de80360b-f277-4a6f-8518-9e95e7c18be3 [ 1178.246040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.246040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.246040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.246040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.246436] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.246533] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de80360b-f277-4a6f-8518-9e95e7c18be3 already deleted. [ 1178.246696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de80360b-f277-4a6f-8518-9e95e7c18be3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.264938] env[66919]: INFO networking_nsxv3.common.synchronization [None req-43a27f01-026d-41f2-8bb6-9b47a51423ba tempest-ServersV294TestFqdnHostnames-212830469 tempest-ServersV294TestFqdnHostnames-212830469-project-member] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1178.265598] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1178.265780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.265880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.265949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.266844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.267275] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.349034] env[66919]: INFO networking_nsxv3.common.synchronization [None req-c47c82b2-d27f-42d7-af0f-c4da234a948f tempest-ServersV294TestFqdnHostnames-212830469 tempest-ServersV294TestFqdnHostnames-212830469-project-member] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1178.349809] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1178.350501] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.350659] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.416165] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.416165] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.416165] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.416949] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.417221] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1178.417435] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1178.417623] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1178.417827] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1178.418026] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1178.418284] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1178.440060] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1178.440060] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1178.440060] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1178.440060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.440060] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-121a21ba-4556-4b3d-8372-f32349af854d taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.440060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.440060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.440060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.440060] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('121a21ba-4556-4b3d-8372-f32349af854d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.543475] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.543770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.543770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.544105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.544200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.544464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.544594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.544744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.544891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.545153] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.545293] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1178.555353] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.574066] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.574254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.574492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.574880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.574949] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.585031] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1178.790109] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.792937] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 already deleted. [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.792937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.792937] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.943142] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.943142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.943142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.943142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.943142] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.943142] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 121a21ba-4556-4b3d-8372-f32349af854d not found, creating... [ 1178.943443] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.943443] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945558] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.945558] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.945558] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 121a21ba-4556-4b3d-8372-f32349af854d is going to be created. [ 1178.967615] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.967615] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.967615] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.967615] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.967937] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.967985] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.059453] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.059664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.059708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.060024] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.060131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.060243] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f is going to be created. [ 1179.099907] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.100106] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.100150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.100350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.100511] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.110887] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: UNINITIALIZED for 2s [ 1179.317067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.317252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.317291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.317521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.317610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.317772] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 already deleted. [ 1179.317841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.096013] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-5e79160f-2f0d-45a1-b492-49212cf25fe1 tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1180.096622] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1180.096958] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.097703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.114085] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-12108a89-d9b6-43f7-a2b5-4a29cb9668a8 service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1180.114270] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-12108a89-d9b6-43f7-a2b5-4a29cb9668a8 service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1180.114410] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-12108a89-d9b6-43f7-a2b5-4a29cb9668a8 service nova] Enqueued Resource ID: 121a21ba-4556-4b3d-8372-f32349af854d with Priority: HIGHEST for action port [ 1180.114622] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1180.114741] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1180.114834] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 121a21ba-4556-4b3d-8372-f32349af854d with Priority: HIGHEST for action port [ 1180.115565] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.115718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.115718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.115894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.115971] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.116787] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.116978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.117074] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-121a21ba-4556-4b3d-8372-f32349af854d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.117174] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.117244] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.117422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.117498] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('121a21ba-4556-4b3d-8372-f32349af854d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.209710] env[66919]: INFO networking_nsxv3.common.synchronization [None req-ec4c0d98-3c3d-441a-8036-286a2d51084a None None] Enqueued Resource ID: b07c713e-5248-426e-a6c6-4da275b54a07 with Priority: HIGHEST for action port [ 1180.210646] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b07c713e-5248-426e-a6c6-4da275b54a07 with Priority: HIGHEST for action port [ 1180.212556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b07c713e-5248-426e-a6c6-4da275b54a07 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.212738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b07c713e-5248-426e-a6c6-4da275b54a07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.212824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b07c713e-5248-426e-a6c6-4da275b54a07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.213109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b07c713e-5248-426e-a6c6-4da275b54a07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.213214] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b07c713e-5248-426e-a6c6-4da275b54a07',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.438812] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-292 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.439162] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.439395] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.439718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.440240] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.440468] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.440593] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.440831] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.440969] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.441186] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.441310] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.441425] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.441534] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.441642] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.441746] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.441875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.462910] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.463226] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1180.463400] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.463584] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-292" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.463935] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-91ed506f-a3b9-4a83-a942-b63bac645c13 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.464150] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.464302] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.464753] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.465129] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ed506f-a3b9-4a83-a942-b63bac645c13',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.595675] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1180.595876] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 deletion is rescheduled due to dependency. [ 1180.595992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.596171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.596420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.596610] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.596725] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.596788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.596943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.597039] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.597127] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.619298] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.619298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.619560] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 121a21ba-4556-4b3d-8372-f32349af854d with status ACTIVE [ 1180.619650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.619767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.619851] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.620114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.620217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.620456] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.620577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.620696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.620899] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.620995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.621247] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.621367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.621443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.621649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.621756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.621868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 121a21ba-4556-4b3d-8372-f32349af854d is going to be updated. [ 1180.643538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.643750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.643750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.643979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.644142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.644298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-121a21ba-4556-4b3d-8372-f32349af854d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.715109] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b07c713e-5248-426e-a6c6-4da275b54a07 [ 1180.715333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.715469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.715535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.715743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.715831] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.715932] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b07c713e-5248-426e-a6c6-4da275b54a07 already deleted. [ 1180.716025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b07c713e-5248-426e-a6c6-4da275b54a07" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.967378] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.967648] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.967827] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.968152] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.968386] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.968579] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 91ed506f-a3b9-4a83-a942-b63bac645c13 not found, creating... [ 1180.968887] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.969096] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.970673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.970673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.970673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.970673] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.970673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.970673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.971092] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.971149] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.971426] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 91ed506f-a3b9-4a83-a942-b63bac645c13 is going to be created. [ 1180.996312] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.996525] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.996656] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.996947] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.997239] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.997475] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.102024] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.122236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: SUCCESS [ 1181.123438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.123438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.123438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.123637] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.123742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.123807] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.124023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.124101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.124229] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.124291] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.603467] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.628119] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.628646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.628646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.628646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.628942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.628942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.629211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.629211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.629441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.629441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.629553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.629619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.629697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.629825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.630083] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.630374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.630448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.630591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.630708] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.630757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.630954] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.698950] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-4f8d97b7-fd32-4c8c-84a6-bbf5113f7a8f service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1181.698950] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-4f8d97b7-fd32-4c8c-84a6-bbf5113f7a8f service nova] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1181.698950] env[66919]: INFO networking_nsxv3.common.synchronization [req-eb531bfe-0869-4f3f-af7c-f05362cec981 req-4f8d97b7-fd32-4c8c-84a6-bbf5113f7a8f service nova] Enqueued Resource ID: 91ed506f-a3b9-4a83-a942-b63bac645c13 with Priority: HIGHEST for action port [ 1181.699488] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_rules [ 1181.699617] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1181.699714] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ed506f-a3b9-4a83-a942-b63bac645c13 with Priority: HIGHEST for action port [ 1181.699967] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.700083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.700287] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.700350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.700515] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ed506f-a3b9-4a83-a942-b63bac645c13 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.700844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.700914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.702027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.702027] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ed506f-a3b9-4a83-a942-b63bac645c13',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.106496] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.106907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.106907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.107092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.107092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.107182] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1182.133214] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae47d158-58bb-4dbc-9056-ccc48ba1c99f: rpc.has_security_group_logging(os_id): False [ 1182.137065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.137235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.137334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.137627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.137834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.148370] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1182.154730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.155047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.155047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.155203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.155279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.155993] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.156613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.156613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.156613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.156780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.156848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.156974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.157206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.157379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.157961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.158283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.158411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.158524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.158790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.158880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.158972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f is going to be created. [ 1182.206027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91ed506f-a3b9-4a83-a942-b63bac645c13 with status ACTIVE [ 1182.206027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.206027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.206027] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.206027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.206027] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91ed506f-a3b9-4a83-a942-b63bac645c13 is going to be updated. [ 1182.225960] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.225960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.225960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.225960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.225960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.226963] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.227227] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.227294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.228178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.228178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.228178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ed506f-a3b9-4a83-a942-b63bac645c13" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.249069] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: IN_PROGRESS for 2s [ 1184.159877] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1184.160301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.160301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.160504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.160819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.160944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.161016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.161170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.161270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.161350] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.262094] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: SUCCESS [ 1184.262363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.663627] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.166044] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.668654] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.668870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.668951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.669907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.669907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.669907] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1185.701826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.702036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.702131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.702379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.702613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.715215] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1186.703096] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1186.703096] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1187.727409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1187.727789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.728254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.728658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.728904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.729803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.729803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.729803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.729803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.729803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.730014] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.730764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.732689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.732689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.732689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.732689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.732689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.732689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.732689] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.235605] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.235758] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.235931] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.738261] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.788290] env[66919]: INFO networking_nsxv3.common.synchronization [req-5da37247-971d-43d1-b7d1-d6fd1e2587f4 req-bbad33bd-7ba2-4cc5-bfc3-5aee71472831 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1188.789056] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1188.789147] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.789633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.789730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.790615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.790810] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.790919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.790990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.791163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.791266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.791357] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.141658] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-718 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.141836] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.142023] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.142255] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.142845] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.143085] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.143327] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.143457] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.143606] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.143874] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.144027] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1189.144104] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1189.144216] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1189.144331] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1189.144439] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1189.145160] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1189.165180] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1189.165379] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1189.165553] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1189.165664] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-718" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.165982] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-d6b57592-c822-4673-9eb2-4190af2dde50 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.166167] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.166283] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.166621] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.166761] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b57592-c822-4673-9eb2-4190af2dde50',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.271594] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.271809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.271886] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.272667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.272667] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.272667] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1189.293788] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.301179] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.301179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.301414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.301508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.301615] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.311868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1189.669203] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.669430] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.669660] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.669948] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.670111] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.670269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port d6b57592-c822-4673-9eb2-4190af2dde50 not found, creating... [ 1189.670537] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.670692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.670879] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.671031] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.671169] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.671487] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.671648] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.671798] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.671964] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.672110] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.672250] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: d6b57592-c822-4673-9eb2-4190af2dde50 is going to be created. [ 1189.695739] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.695739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.695739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.695739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.695739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.695739] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.796551] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.300041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.300225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.300329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.300561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.300658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.300766] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1190.335689] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.335689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.335803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.336057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.336262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.348433] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [req-5da37247-971d-43d1-b7d1-d6fd1e2587f4 req-e3af2ff7-8468-43e0-881f-a7c41070311d service nova] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [req-5da37247-971d-43d1-b7d1-d6fd1e2587f4 req-e3af2ff7-8468-43e0-881f-a7c41070311d service nova] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [req-5da37247-971d-43d1-b7d1-d6fd1e2587f4 req-e3af2ff7-8468-43e0-881f-a7c41070311d service nova] Enqueued Resource ID: d6b57592-c822-4673-9eb2-4190af2dde50 with Priority: HIGHEST for action port [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_rules [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1190.898133] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b57592-c822-4673-9eb2-4190af2dde50 with Priority: HIGHEST for action port [ 1190.898819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.898819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.898819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.899110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.899165] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.900303] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.900411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.900639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b57592-c822-4673-9eb2-4190af2dde50 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.904147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.904147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.904147] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.904147] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b57592-c822-4673-9eb2-4190af2dde50',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.025054] env[66919]: INFO networking_nsxv3.common.synchronization [None req-4845999e-8966-41c9-bc07-dc731b195970 None None] Enqueued Resource ID: 5916d171-0e1d-4c2c-b80d-4b1bf8c772d7 with Priority: HIGHEST for action port [ 1191.025195] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5916d171-0e1d-4c2c-b80d-4b1bf8c772d7 with Priority: HIGHEST for action port [ 1191.029023] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5916d171-0e1d-4c2c-b80d-4b1bf8c772d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.029023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5916d171-0e1d-4c2c-b80d-4b1bf8c772d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.029023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5916d171-0e1d-4c2c-b80d-4b1bf8c772d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.029023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5916d171-0e1d-4c2c-b80d-4b1bf8c772d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.029023] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5916d171-0e1d-4c2c-b80d-4b1bf8c772d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.325249] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1191.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.325249] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.325249] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.325650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.325650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.325650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.325650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.325776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.325813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.326029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.326204] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.326281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.326466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.326466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.326577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.328038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.328038] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.406411] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.406411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.406411] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6b57592-c822-4673-9eb2-4190af2dde50 with status ACTIVE [ 1191.406626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.406683] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.407145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.407145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.407263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.407434] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.407571] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.408032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.408032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.408032] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.408273] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.408411] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.408504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.409132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.409132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.409132] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6b57592-c822-4673-9eb2-4190af2dde50 is going to be updated. [ 1191.440341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.440341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.440341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.440341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.440341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.440341] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b57592-c822-4673-9eb2-4190af2dde50" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.530562] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5916d171-0e1d-4c2c-b80d-4b1bf8c772d7 [ 1191.530816] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.530958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.531042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.531271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.531386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.531514] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5916d171-0e1d-4c2c-b80d-4b1bf8c772d7 already deleted. [ 1191.531587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5916d171-0e1d-4c2c-b80d-4b1bf8c772d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.829068] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365f0d7e-3740-4616-bfcb-3bab286dfb33: rpc.has_security_group_logging(os_id): False [ 1191.848316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.850135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.850135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.850135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.850135] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.850602] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.850602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.850602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.850774] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.850821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.851022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.851114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.851179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.851324] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.851389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.851575] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.851669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.851721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.851864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.851938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.852034] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1191.911136] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.912100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.912100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.912100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.912100] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.924673] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1192.361898] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1192.362103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.362286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.362587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.363096] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.363096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.363096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.363096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.363282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.363282] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.868423] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.371050] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.388404] env[66919]: INFO networking_nsxv3.common.synchronization [req-5218f46e-425b-4b1f-b469-e76e853ee484 req-1a00ea57-9a51-46af-8070-cbe48cc3f86f tempest-ServersV294TestFqdnHostnames-212830469 tempest-ServersV294TestFqdnHostnames-212830469-project-member] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1193.389131] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1193.389441] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.390095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.390207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.390473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.390642] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.390785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.390821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.391034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.391128] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.391227] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.471167] env[66919]: INFO networking_nsxv3.common.synchronization [None req-fe490680-3282-457a-bd84-9715b9d76e20 None None] Enqueued Resource ID: f10a9ea2-072c-4cd3-82cc-6971b86e7b23 with Priority: HIGHEST for action port [ 1193.471167] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f10a9ea2-072c-4cd3-82cc-6971b86e7b23 with Priority: HIGHEST for action port [ 1193.471708] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-f10a9ea2-072c-4cd3-82cc-6971b86e7b23 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.471839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f10a9ea2-072c-4cd3-82cc-6971b86e7b23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.471903] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f10a9ea2-072c-4cd3-82cc-6971b86e7b23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.472391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f10a9ea2-072c-4cd3-82cc-6971b86e7b23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.472515] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f10a9ea2-072c-4cd3-82cc-6971b86e7b23',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.812921] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-73 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.813204] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-73" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.813439] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-73" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.814026] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-73" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.814682] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.814682] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.814877] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.815198] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.815434] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.815783] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.816028] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.816292] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.816441] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.816610] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.816789] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.817058] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.840994] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.841219] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.841378] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.841605] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-73" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.841983] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-3f527050-98d3-4421-8167-7eb908282256 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.842220] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.842381] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.842822] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.843057] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f527050-98d3-4421-8167-7eb908282256',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.873071] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.873306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.873373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.873536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.873625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.873723] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1193.893951] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.894181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.894256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.894461] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.894547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.894763] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.894869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.894940] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.895113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.895212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.895300] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 already deleted. [ 1193.895380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.930808] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.931103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.931194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.931499] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.931713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.943445] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1193.944504] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1193.944819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.945115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.945408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.945573] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.975620] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f10a9ea2-072c-4cd3-82cc-6971b86e7b23 [ 1193.975892] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.976050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.976110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.976352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.976444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.976541] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f10a9ea2-072c-4cd3-82cc-6971b86e7b23 already deleted. [ 1193.976699] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f10a9ea2-072c-4cd3-82cc-6971b86e7b23" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.345387] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.345759] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.345911] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.346287] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.346537] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.346724] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 3f527050-98d3-4421-8167-7eb908282256 not found, creating... [ 1194.347045] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.347218] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.347333] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.347644] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.347840] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.348157] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.348315] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.348427] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.348670] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.348817] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.348990] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 3f527050-98d3-4421-8167-7eb908282256 is going to be created. [ 1194.370345] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.370597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.370709] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.370978] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.371223] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.371493] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.448285] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.448552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.448783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.449449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.449449] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.450016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.450163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.450382] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.450471] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.450570] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.450665] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.953607] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.953765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.953857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.954068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.954236] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.954339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.954403] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.954560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.954652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.954744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.954888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.954979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.955068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.955224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.955364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.955453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.955515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.955646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.955720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.955800] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.955887] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.090844] env[66919]: INFO networking_nsxv3.common.synchronization [req-5218f46e-425b-4b1f-b469-e76e853ee484 req-0b868aa4-9dae-4c77-aca4-ea1693163c01 service nova] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1195.091053] env[66919]: INFO networking_nsxv3.common.synchronization [req-5218f46e-425b-4b1f-b469-e76e853ee484 req-0b868aa4-9dae-4c77-aca4-ea1693163c01 service nova] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1195.091195] env[66919]: INFO networking_nsxv3.common.synchronization [req-5218f46e-425b-4b1f-b469-e76e853ee484 req-0b868aa4-9dae-4c77-aca4-ea1693163c01 service nova] Enqueued Resource ID: 3f527050-98d3-4421-8167-7eb908282256 with Priority: HIGHEST for action port [ 1195.091700] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_rules [ 1195.091834] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1195.091931] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f527050-98d3-4421-8167-7eb908282256 with Priority: HIGHEST for action port [ 1195.092556] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.092712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.092795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.093111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.093211] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.094364] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.094533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.094784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.094888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.095134] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.095288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.095393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.095621] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.095760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.095901] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.100455] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f527050-98d3-4421-8167-7eb908282256 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.100455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.100455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.100455] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.100455] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f527050-98d3-4421-8167-7eb908282256',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.334871] env[66919]: INFO networking_nsxv3.common.synchronization [req-9379742d-a1e2-4e3d-bffe-3d27d2a4fa79 req-f0231443-a01a-4720-9ae9-6c9c426ff7ea tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1195.334871] env[66919]: INFO networking_nsxv3.common.synchronization [req-8045d1de-8624-4921-9a32-06f5cdbef20c req-9ad84311-0461-4263-a2bb-8aae6360754f tempest-InstanceActionsTestJSON-414303718 tempest-InstanceActionsTestJSON-414303718-project-member] Enqueued Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1195.334871] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1195.335210] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGHEST for action security_group_members [ 1195.335210] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.335303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.335479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.335567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.335720] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.335813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.335871] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.336047] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.336105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.336191] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.336990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.337213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.337303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.337484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.337653] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.337773] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.337852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.338029] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.338183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.338247] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.458629] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 365f0d7e-3740-4616-bfcb-3bab286dfb33: rpc.has_security_group_logging(os_id): False [ 1195.477157] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.477345] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.477391] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.477618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.477711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.477946] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.478062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.478137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.478319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.478413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.478612] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.478727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.478793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.478951] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.479036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.479226] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.479330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.479392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.479526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.479631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.479722] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1195.591764] env[66919]: INFO networking_nsxv3.common.synchronization [req-f4887189-d9c9-4cfb-a2d7-389b03a70365 req-bec717ac-08a3-4822-8823-53152e7f8b4f tempest-MultipleCreateTestJSON-84724283 tempest-MultipleCreateTestJSON-84724283-project-member] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1195.592496] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGHEST for action security_group_members [ 1195.592758] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.592887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.603298] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.603466] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.603612] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.605501] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3f527050-98d3-4421-8167-7eb908282256 with status ACTIVE [ 1195.606044] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.606205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.606271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.606530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.606640] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.606990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.607110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.607193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.608077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.608575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.608982] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.609444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.609490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.609780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.609952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.610209] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3f527050-98d3-4421-8167-7eb908282256 is going to be updated. [ 1195.626335] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.626634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.626634] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.626767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.626917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.635701] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.635841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.635964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.636146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.636296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.636467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f527050-98d3-4421-8167-7eb908282256" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.644960] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1195.841396] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.842536] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.842665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.842728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.842934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.843036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.843235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.843322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.843377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.843527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.843644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.843703] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f is going to be updated. [ 1195.872234] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.872472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.872533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.872733] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.872878] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.883929] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: IN_PROGRESS for 2s [ 1195.955742] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1195.955967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.956156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.956385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.956584] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.956704] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.956767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.956923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.957011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.957103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.957194] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.110972] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-400 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.111201] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.111329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.111615] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.111878] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.112053] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.112173] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.112391] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.112540] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.112761] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.112877] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.112989] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.113111] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.113220] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1196.113323] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.113460] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.115069] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.138506] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.138700] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1196.138849] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.139034] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-400" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.139353] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-1a505571-00de-472f-9d83-0cb0e111d899 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.139527] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.139663] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.139953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.140108] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a505571-00de-472f-9d83-0cb0e111d899',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.346532] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.460078] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.617989] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.619365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.619495] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.619817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.619923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.620093] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 is going to be created. [ 1196.642783] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.643057] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.643167] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.643643] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.643814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.644132] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.644323] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.644507] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.644754] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.644903] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.645222] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.645389] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.645508] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.646381] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.646381] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.646381] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 1a505571-00de-472f-9d83-0cb0e111d899 is going to be updated. [ 1196.647885] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.648013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.648013] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.648191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.648386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.659817] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: UNINITIALIZED for 2s [ 1196.668802] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.669094] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.669160] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.669419] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.669658] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.669855] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.848854] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.849012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.849121] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.849343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.849444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.849543] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1196.885082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.885082] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.885593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.885593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.885759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.898923] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1196.963118] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b46dc5c-dcd7-49a6-a2b6-31024aac0805: rpc.has_security_group_logging(os_id): False [ 1196.983586] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.983778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.983778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.984117] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.984346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.984629] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.984764] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.984850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.985052] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.985158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.985255] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1197.050740] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.050947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.051016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.051199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.051346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.066995] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1197.383148] env[66919]: INFO networking_nsxv3.common.synchronization [req-3f68f6b0-2d9e-4aa6-b8c9-5971a0f5c9cc req-be8c9ce1-c4e0-42fd-803f-c3eb9a0f2521 service nova] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1197.383303] env[66919]: INFO networking_nsxv3.common.synchronization [req-3f68f6b0-2d9e-4aa6-b8c9-5971a0f5c9cc req-be8c9ce1-c4e0-42fd-803f-c3eb9a0f2521 service nova] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1197.383525] env[66919]: INFO networking_nsxv3.common.synchronization [req-3f68f6b0-2d9e-4aa6-b8c9-5971a0f5c9cc req-be8c9ce1-c4e0-42fd-803f-c3eb9a0f2521 service nova] Enqueued Resource ID: 1a505571-00de-472f-9d83-0cb0e111d899 with Priority: HIGHEST for action port [ 1197.385931] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_rules [ 1197.385931] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1197.385931] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a505571-00de-472f-9d83-0cb0e111d899 with Priority: HIGHEST for action port [ 1197.385931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.385931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.385931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.385931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.385931] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.386779] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.386847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.386914] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.387112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.387272] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.387367] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.387419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.387558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.387644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.389272] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.389272] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a505571-00de-472f-9d83-0cb0e111d899 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.389272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.389272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.389272] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.389272] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a505571-00de-472f-9d83-0cb0e111d899',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.659899] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1197.660297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.890873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.891243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.893041] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.893041] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a505571-00de-472f-9d83-0cb0e111d899 with status ACTIVE [ 1197.893041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.893041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.893041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.893041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.893041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.893369] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.893369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.893369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.893518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.893593] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.893773] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.893867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.893927] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.894080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.894152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.894236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a505571-00de-472f-9d83-0cb0e111d899 is going to be updated. [ 1197.896346] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f in Status: SUCCESS [ 1197.896346] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f deletion is rescheduled due to dependency. [ 1197.896518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.914907] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.914907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.915079] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.915190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.915323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.915481] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a505571-00de-472f-9d83-0cb0e111d899" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.397087] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.670080] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: SUCCESS [ 1198.670361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.670468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.670722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.670858] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.671030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.671064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.671195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.671275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.671358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.671448] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.893014] env[66919]: INFO networking_nsxv3.common.synchronization [req-f288eafd-2e81-40af-a7d0-8f3f68f518ef req-574b4bfd-f035-42ac-a30a-92c1a9e289d4 tempest-ServerAddressesTestJSON-1970047333 tempest-ServerAddressesTestJSON-1970047333-project-member] Enqueued Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1198.893686] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1198.894065] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.894254] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.894330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.894592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.895158] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.895269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.895334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.895490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.895573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.895664] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.899067] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.899212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.899315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.899516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.899618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.899738] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be updated. [ 1198.915528] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1198.915788] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.915984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.916258] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.916472] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.916618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.916700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.916897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.916981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.917119] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.930864] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.931048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.931104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.931294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.931549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.941413] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: IN_PROGRESS for 2s [ 1199.084748] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1199.084964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.174393] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.211526] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-974 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.211682] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-974" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.211793] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-974" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.212169] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-974" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.212440] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.212601] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.212781] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.212953] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.213086] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.213295] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.213408] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.213515] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.213613] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.213719] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.213826] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.213968] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.239343] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.239523] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.239668] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.239857] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-974" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.240189] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-c2142b8d-4875-4238-8fd2-54ad6fd87927 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.240364] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.240479] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.241489] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.241664] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2142b8d-4875-4238-8fd2-54ad6fd87927',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.398217] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.398404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.398404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.398759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.398883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.399135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.399304] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.399394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.399609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.399853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.399933] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c already deleted. [ 1199.400031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.420000] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.420245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.420245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.420494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.420613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.420795] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.420898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.420999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.421231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.421337] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.421427] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be updated. [ 1199.450572] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.450866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.450866] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.451101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.451164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.461419] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: IN_PROGRESS for 2s [ 1199.677195] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8a05be69-3f5e-4c39-8a1b-381e428a3950: rpc.has_security_group_logging(os_id): False [ 1199.696248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.696392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.696465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.696752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.696846] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.697115] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.697224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.697290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.697449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.697525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.697614] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 is going to be created. [ 1199.745175] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.745415] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.745543] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.745827] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.746012] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.746218] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port c2142b8d-4875-4238-8fd2-54ad6fd87927 not found, creating... [ 1199.746427] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.746583] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.746706] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.746937] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.747092] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.747378] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.747531] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.747646] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.747850] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.747991] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.748131] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: c2142b8d-4875-4238-8fd2-54ad6fd87927 is going to be created. [ 1199.757953] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.758109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.758168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.758371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.758544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.770857] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.771262] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.771359] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.771582] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.771810] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.772051] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.774084] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: IN_PROGRESS for 2s [ 1200.522507] env[66919]: INFO networking_nsxv3.common.synchronization [req-f288eafd-2e81-40af-a7d0-8f3f68f518ef req-ef38b17c-3256-498d-addf-db6aa4d77a02 service nova] Enqueued Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_rules [ 1200.522676] env[66919]: INFO networking_nsxv3.common.synchronization [req-f288eafd-2e81-40af-a7d0-8f3f68f518ef req-ef38b17c-3256-498d-addf-db6aa4d77a02 service nova] Enqueued Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1200.522865] env[66919]: INFO networking_nsxv3.common.synchronization [req-f288eafd-2e81-40af-a7d0-8f3f68f518ef req-ef38b17c-3256-498d-addf-db6aa4d77a02 service nova] Enqueued Resource ID: c2142b8d-4875-4238-8fd2-54ad6fd87927 with Priority: HIGHEST for action port [ 1200.523340] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_rules [ 1200.523467] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1200.523558] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2142b8d-4875-4238-8fd2-54ad6fd87927 with Priority: HIGHEST for action port [ 1200.523851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.525022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.525022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.525815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.525909] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.526857] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.527016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.527067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.527235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.527380] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.527474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.527526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.527660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.527741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.527871] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.528636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2142b8d-4875-4238-8fd2-54ad6fd87927 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.528775] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.528821] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.528964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.529046] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2142b8d-4875-4238-8fd2-54ad6fd87927',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.951727] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: SUCCESS [ 1200.952109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.952533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.952785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.952997] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.953138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.953215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.953385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.953469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.953555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.953657] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.030280] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.031535] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.031653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.031864] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2142b8d-4875-4238-8fd2-54ad6fd87927 with status ACTIVE [ 1201.032090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.032214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.032276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.032454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.032536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.032724] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.032817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.032884] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.033425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.035253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.035253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.035253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.035253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.035253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.035253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.035253] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2142b8d-4875-4238-8fd2-54ad6fd87927 is going to be updated. [ 1201.063405] env[66919]: INFO networking_nsxv3.common.synchronization [req-e3edba75-3328-4b7e-a144-ad4bb45dc5b7 req-e9485db3-2c77-4ea2-8604-ffc77444fe06 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1201.064256] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1201.064660] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.065056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.065056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.065234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.065437] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.065581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.065728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.065813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.065990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.066145] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.076636] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.076636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.076636] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.076939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.076971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.077230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2142b8d-4875-4238-8fd2-54ad6fd87927" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.458784] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.479551] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 in Status: SUCCESS [ 1201.479551] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 deletion is rescheduled due to dependency. [ 1201.479748] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.536339] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.570372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.570618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.570618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.571312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.571312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.571312] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.571477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.571477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.573026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.573026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.573026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1201.606899] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.607568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.607654] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.607863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.607998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.629293] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1201.788055] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: SUCCESS [ 1201.788327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.960819] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a49750f4-d44e-4a2c-9149-0e26c8f444f0: rpc.has_security_group_logging(os_id): False [ 1201.984305] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.984474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.984565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.984803] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.984881] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.986181] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.986181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.986181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.986181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.986181] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.986181] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be updated. [ 1202.039626] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.039864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.039864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.040105] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.040200] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.040303] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c is going to be created. [ 1202.060826] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.061104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.061104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.061252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.061394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.074023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: IN_PROGRESS for 2s [ 1202.087690] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.087883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.087961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.088193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.088422] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.100757] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: UNINITIALIZED for 2s [ 1203.639944] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1203.640558] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 deletion is rescheduled due to dependency. [ 1203.640558] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.092889] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: SUCCESS [ 1204.092889] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.114334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: SUCCESS [ 1204.114334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.114334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.114334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.114615] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.114742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.114742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.114964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.114964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.115144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.115144] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.618034] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.618281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.618281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.618360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.618639] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.618639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.618922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.618922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.619075] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.619111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.619261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.619355] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.619415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.619561] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.619703] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.619857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.619943] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.620109] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.620186] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.620271] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.620362] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.122827] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 865ff4e5-b005-48b2-abcb-24019b5baf5c: rpc.has_security_group_logging(os_id): False [ 1205.147392] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.147606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.147753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.148132] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.148342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.148591] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.148707] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.148772] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.149023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.149168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.149450] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.149592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.149666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.149828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.149907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.150123] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.150286] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.150408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.150591] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.151025] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.151025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c is going to be created. [ 1205.223389] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.223627] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.223680] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.223934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.224494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.246515] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: IN_PROGRESS for 2s [ 1206.065250] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1206.066733] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1206.567524] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d52b0fe0-d897-4bd0-b2dc-a682212abfad None None] Enqueued Resource ID: 6dfc7656-d1c7-4469-a50e-0b4308e7b06a with Priority: HIGHEST for action port [ 1206.567524] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dfc7656-d1c7-4469-a50e-0b4308e7b06a with Priority: HIGHEST for action port [ 1206.567524] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6dfc7656-d1c7-4469-a50e-0b4308e7b06a taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.567524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6dfc7656-d1c7-4469-a50e-0b4308e7b06a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.567524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6dfc7656-d1c7-4469-a50e-0b4308e7b06a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.568081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6dfc7656-d1c7-4469-a50e-0b4308e7b06a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.568081] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6dfc7656-d1c7-4469-a50e-0b4308e7b06a',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.071294] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6dfc7656-d1c7-4469-a50e-0b4308e7b06a [ 1207.071570] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.071727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.071776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.071974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.072086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.072188] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6dfc7656-d1c7-4469-a50e-0b4308e7b06a already deleted. [ 1207.072267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6dfc7656-d1c7-4469-a50e-0b4308e7b06a" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.260935] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: SUCCESS [ 1207.261188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.355023] env[66919]: INFO networking_nsxv3.common.synchronization [None req-d545c206-17c8-4b28-9549-c6a3e81106d4 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1207.355023] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1207.357261] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.357261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.357261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.357261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.357261] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.461723] env[66919]: INFO networking_nsxv3.common.synchronization [None req-753885b0-bc81-4a3b-bcb9-848f6bbc64d4 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1207.462112] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1207.462341] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.462444] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.886089] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.886089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.886089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.886089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.886089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.886089] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 already deleted. [ 1207.886089] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.886657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.886657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.886657] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.417040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.417040] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.417309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.417309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.417423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.417506] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 already deleted. [ 1208.417543] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.947013] env[66919]: INFO networking_nsxv3.common.synchronization [None req-09512ff3-41c6-45ce-a96e-2de8d3e6a0fa None None] Enqueued Resource ID: a55d429a-8470-4808-b36a-8ad1422638cd with Priority: HIGHEST for action port [ 1208.947677] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a55d429a-8470-4808-b36a-8ad1422638cd with Priority: HIGHEST for action port [ 1208.948051] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-a55d429a-8470-4808-b36a-8ad1422638cd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.948926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a55d429a-8470-4808-b36a-8ad1422638cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.948926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a55d429a-8470-4808-b36a-8ad1422638cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.948926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a55d429a-8470-4808-b36a-8ad1422638cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.948926] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a55d429a-8470-4808-b36a-8ad1422638cd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.451952] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a55d429a-8470-4808-b36a-8ad1422638cd [ 1209.452299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.452467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.452606] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.452858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.452996] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.453151] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a55d429a-8470-4808-b36a-8ad1422638cd already deleted. [ 1209.453279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a55d429a-8470-4808-b36a-8ad1422638cd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.009315] env[66919]: INFO networking_nsxv3.common.synchronization [req-bc80a732-2cde-4903-a0aa-84d3c7698254 req-3a3dea13-2a9e-46be-8769-ceda95ef97b8 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1212.009577] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1212.009731] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.009852] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.010477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.010477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.010477] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.010477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.010477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.010711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.010711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.010772] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.340867] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.340867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.340867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.340867] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.343907] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.344139] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.344262] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.344534] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.344679] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.344970] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.345157] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.345287] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.345393] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.345753] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.345753] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.345753] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.371237] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.371237] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.371237] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.371237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.371237] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-6a3dc58c-9814-49b8-8c15-271624e2d57e taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.371237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.371237] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.371743] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.371743] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3dc58c-9814-49b8-8c15-271624e2d57e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.516260] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.516489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.516619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.516935] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.517107] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.517424] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.517572] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.517664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.517923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.518351] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.518351] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1212.549706] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.549963] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.550097] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.550408] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.550609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.562893] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1212.874093] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.874340] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.874452] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.874740] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.874885] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.875052] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 6a3dc58c-9814-49b8-8c15-271624e2d57e not found, creating... [ 1212.875308] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.875460] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.875573] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.875817] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.875933] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.876224] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.876375] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.876491] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.876696] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.876826] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.876981] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e is going to be created. [ 1212.901240] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.901538] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.901662] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.901924] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.902161] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.902379] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.610921] env[66919]: INFO networking_nsxv3.common.synchronization [req-bc80a732-2cde-4903-a0aa-84d3c7698254 req-4f2a740c-f066-4f5b-b12f-fcef85b01a3a service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1213.611374] env[66919]: INFO networking_nsxv3.common.synchronization [req-bc80a732-2cde-4903-a0aa-84d3c7698254 req-4f2a740c-f066-4f5b-b12f-fcef85b01a3a service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1213.611374] env[66919]: INFO networking_nsxv3.common.synchronization [req-bc80a732-2cde-4903-a0aa-84d3c7698254 req-4f2a740c-f066-4f5b-b12f-fcef85b01a3a service nova] Enqueued Resource ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e with Priority: HIGHEST for action port [ 1213.611913] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1213.612072] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1213.612171] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e with Priority: HIGHEST for action port [ 1213.612498] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.612771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.612771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.612888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.612993] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.614090] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.614090] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.614235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a3dc58c-9814-49b8-8c15-271624e2d57e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.614235] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.614420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.614507] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.614580] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3dc58c-9814-49b8-8c15-271624e2d57e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.115997] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.116139] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.117528] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a3dc58c-9814-49b8-8c15-271624e2d57e with status ACTIVE [ 1214.117932] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.118104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.118207] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.118456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.118585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.119041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.119041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.119041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.119369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.119520] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.119833] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.120500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.120500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.120500] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.120669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.120705] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e is going to be updated. [ 1214.142151] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.142415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.142415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.142560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.142614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.142778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.344352] env[66919]: INFO networking_nsxv3.common.synchronization [req-e2720fa6-ee4f-4889-88c8-279cfcf5fd6d req-1a7bd96e-4ac3-4704-9128-853c07c16fa2 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1214.344918] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1214.345244] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.345366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.345433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.345687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.345851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.345959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.346084] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.346256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.346342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.346436] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.516755] env[66919]: INFO networking_nsxv3.common.synchronization [req-216d248a-a5ee-406f-ab6e-0489c675082b req-7d0f08e9-fd26-487d-a19e-723a3c370c38 tempest-ServerAddressesTestJSON-1970047333 tempest-ServerAddressesTestJSON-1970047333-project-member] Enqueued Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1214.517357] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGHEST for action security_group_members [ 1214.518292] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.518515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.518602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.519595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.519595] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.519728] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.519777] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.520092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.520092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.520213] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.574536] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1214.574782] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 deletion is rescheduled due to dependency. [ 1214.574938] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.575433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.575433] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.575652] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.575787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.575856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.576074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.576166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.576593] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.771145] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.771145] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.771534] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.771578] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.771841] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.772009] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.772127] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.772339] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.772478] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.772684] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.772832] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1214.772912] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1214.773022] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1214.773144] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1214.773236] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1214.773370] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1214.792475] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1214.792710] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1214.792773] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1214.792935] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.793265] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.793526] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.793602] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.793860] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.793996] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1a0a6f-5a81-447b-beb3-68f1aa554fc6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.848828] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.849073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.849213] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.849587] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.849760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.849906] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.850041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.850127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.850375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.850517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.850652] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 already deleted. [ 1214.850799] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.022505] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.022714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.022714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.023023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.023144] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.023371] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.023484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.023568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.023787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.023872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.023962] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c is going to be updated. [ 1215.054944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.054944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.054944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.054944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.054944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.063605] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: IN_PROGRESS for 2s [ 1215.083589] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.296349] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.296646] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.296832] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.297211] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.297352] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.297565] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 not found, creating... [ 1215.297883] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.298083] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.298228] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.298478] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.298614] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.298887] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.299082] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.299205] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.299406] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.299531] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.299664] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 is going to be created. [ 1215.320459] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.320688] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.320833] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.321170] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.321440] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.321688] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.587239] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.020701] env[66919]: INFO networking_nsxv3.common.synchronization [req-e2720fa6-ee4f-4889-88c8-279cfcf5fd6d req-ec5d91bd-0f61-4087-a776-8fce79f3b85d service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1216.020981] env[66919]: INFO networking_nsxv3.common.synchronization [req-e2720fa6-ee4f-4889-88c8-279cfcf5fd6d req-ec5d91bd-0f61-4087-a776-8fce79f3b85d service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1216.021046] env[66919]: INFO networking_nsxv3.common.synchronization [req-e2720fa6-ee4f-4889-88c8-279cfcf5fd6d req-ec5d91bd-0f61-4087-a776-8fce79f3b85d service nova] Enqueued Resource ID: ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 with Priority: HIGHEST for action port [ 1216.021618] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1216.021784] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1216.021886] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 with Priority: HIGHEST for action port [ 1216.023143] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.023344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.023457] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.023869] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.023869] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.025394] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.025664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.025776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.026783] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.026999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.027077] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.027150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.027321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.027410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.027507] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.028379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.028510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.028577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.028740] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.028817] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef1a0a6f-5a81-447b-beb3-68f1aa554fc6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.089366] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.089569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.089625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.089818] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.089909] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.090061] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1216.120085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.120275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.120275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.121279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.121279] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.129570] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1216.530777] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.532290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.532290] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.532497] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 with status ACTIVE [ 1216.532542] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.532650] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.532761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.533152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.533152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.533152] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.533319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.533319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.533464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.533522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.533695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.533812] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.533867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.533970] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.534057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.534134] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef1a0a6f-5a81-447b-beb3-68f1aa554fc6 is going to be updated. [ 1216.554356] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.554502] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.554585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.554825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.554959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.555137] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef1a0a6f-5a81-447b-beb3-68f1aa554fc6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.033165] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.073713] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c in Status: SUCCESS [ 1217.073908] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c deletion is rescheduled due to dependency. [ 1217.074031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.535947] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.535947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.535947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.535947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.535947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.535947] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be created. [ 1217.561363] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.561363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.561363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.561678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.561678] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.572249] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: UNINITIALIZED for 2s [ 1218.139993] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1218.140426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.140563] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.140797] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.141012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.141142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.141209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.141416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.141618] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.141730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.141832] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.644188] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.146302] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 1219.165529] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.165687] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.165742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.165961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.166072] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.166324] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.166489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.166489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.166766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.166835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.166939] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1219.244570] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.244819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.244819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.244995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.245161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.259119] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1219.583138] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1219.583504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.583738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.584023] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.584358] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.584526] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.584630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.584848] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.584978] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.585108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.585254] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.088412] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.590317] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 477edf9b-362d-4dfc-a63d-98bae4607734: rpc.has_security_group_logging(os_id): False [ 1220.618276] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.618710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.618710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.618823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.618897] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.619213] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.619339] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.619573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.619573] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.619638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.619867] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be created. [ 1220.684638] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.684638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.684638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.684638] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.684823] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.695820] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1221.022971] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1221.023163] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1221.274491] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1221.274761] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.709343] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1222.709750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.394857] env[66919]: INFO networking_nsxv3.common.synchronization [req-f52f542c-b736-46e3-afe3-d462c5fcc383 req-9ba70172-aaeb-4262-a5e0-f68f34080ad0 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1223.395520] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGHEST for action security_group_members [ 1223.395906] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.396063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.396802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.396802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.396802] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.396802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.396802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.397245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.397245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.397245] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.900088] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.900088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.900610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.900610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.900610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.900827] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.900959] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.901046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.901259] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.901343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.901433] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 is going to be updated. [ 1223.956459] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.956668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.956668] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.956882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.957042] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.970612] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: IN_PROGRESS for 2s [ 1225.981850] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 in Status: SUCCESS [ 1225.982234] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 deletion is rescheduled due to dependency. [ 1225.982234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.114593] env[66919]: INFO networking_nsxv3.common.synchronization [None req-5c223aec-7c8e-421e-ae05-95a04be02124 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1228.115174] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1228.115481] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.115604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.115670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.115929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.116020] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.201380] env[66919]: INFO networking_nsxv3.common.synchronization [None req-e3bcbe9b-1569-4519-a015-9d4298563a80 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1228.201750] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1228.202776] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.202776] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.638625] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.638850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.638850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.639031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.639123] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.639219] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d already deleted. [ 1228.639362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.639525] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.639691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.639776] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.161977] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.161977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.161977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.161977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.161977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.161977] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d already deleted. [ 1229.162534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.203254] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.204892] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1233.613516] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6b3f077-74be-42cf-ba02-c752ea27d41c req-00e38105-00c5-41d8-92ce-d96508860688 tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1233.614072] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1233.614372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.614486] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.614555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.614833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.615022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.615129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.615193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.615460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.615460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.615578] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1233.886501] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-879 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.886705] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.886829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.887109] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.887409] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.887577] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.887692] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.887907] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.888058] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.888262] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.888385] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1233.888491] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1233.888594] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1233.888699] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1233.888799] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1233.888926] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1233.909984] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1233.910171] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1233.910310] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1233.910481] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-879" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1233.910792] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1233.910959] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1233.911089] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1233.911457] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1233.911619] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3dd0b0b-e9cf-401b-aaa1-768d44f34f99',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.117866] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.118041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.118098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.118306] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.118397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.118691] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.118802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.118861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.119027] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.119108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.119194] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d already deleted. [ 1234.119273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.414196] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.414617] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.414617] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.414815] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.414964] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.415137] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 not found, creating... [ 1234.415392] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.415565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.415672] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.415923] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.416048] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.416325] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.416480] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.416597] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.416800] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.416933] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.417084] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 is going to be created. [ 1234.436965] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.437209] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.437295] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.437581] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.437810] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.438035] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.128178] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6b3f077-74be-42cf-ba02-c752ea27d41c req-5036ebb1-4a64-4b36-916b-2971399ce467 service nova] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1235.128364] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6b3f077-74be-42cf-ba02-c752ea27d41c req-5036ebb1-4a64-4b36-916b-2971399ce467 service nova] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1235.128502] env[66919]: INFO networking_nsxv3.common.synchronization [req-c6b3f077-74be-42cf-ba02-c752ea27d41c req-5036ebb1-4a64-4b36-916b-2971399ce467 service nova] Enqueued Resource ID: e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 with Priority: HIGHEST for action port [ 1235.129045] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_rules [ 1235.129181] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1235.129276] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 with Priority: HIGHEST for action port [ 1235.129574] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.129686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.129755] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.129953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.130181] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.131169] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.131325] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.131423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.131643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.131830] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.131958] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.132062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.133037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.133037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.133037] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.133686] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.133686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.133862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.134099] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.134207] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3dd0b0b-e9cf-401b-aaa1-768d44f34f99',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.636439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.636864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.636864] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.637999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 with status ACTIVE [ 1235.638208] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.638328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.638397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.638602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.638692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.640041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.640041] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.640041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.640041] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3dd0b0b-e9cf-401b-aaa1-768d44f34f99 is going to be updated. [ 1235.662973] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.663194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.663194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.663396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.663532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.663692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3dd0b0b-e9cf-401b-aaa1-768d44f34f99" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.142094] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.644804] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.645253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.645253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.645434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.645585] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.645734] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d is going to be created. [ 1236.673874] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.674140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.674220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.674441] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.674698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.684310] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: UNINITIALIZED for 2s [ 1238.696025] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: SUCCESS [ 1238.696323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.696430] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.696646] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.698071] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.698071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.698071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.698071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.698071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.698071] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.698071] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.202089] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.704955] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e44ceb5-d132-4c72-9fdc-3384663a523d: rpc.has_security_group_logging(os_id): False [ 1239.727187] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.727397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.727397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.727567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.727658] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.727931] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.728057] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.728122] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.728275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.728349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.728437] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d is going to be created. [ 1239.799290] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.799534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.799534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.799722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.799906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.815532] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: IN_PROGRESS for 2s [ 1239.827032] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1239.827184] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1240.129849] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1240.130050] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1241.829023] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: SUCCESS [ 1241.829398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.131157] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1245.131605] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1245.317846] env[66919]: INFO networking_nsxv3.common.synchronization [req-87396c0a-674c-4c86-ac78-78f32f8a399a req-0d9bc735-33c8-4e1c-8455-961225710a66 tempest-ServersV294TestFqdnHostnames-212830469 tempest-ServersV294TestFqdnHostnames-212830469-project-member] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1245.318443] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGHEST for action security_group_members [ 1245.318887] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.319080] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.319189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.319473] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.319760] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.319920] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.320035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.320287] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.320421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.320635] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.823033] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.823255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.823313] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.823487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.823581] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.823770] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.823870] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.823934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.824113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.824193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.824305] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 is going to be updated. [ 1245.854294] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.854521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.854521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.854693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.854853] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.863652] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: IN_PROGRESS for 2s [ 1247.875078] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 in Status: SUCCESS [ 1247.875078] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 deletion is rescheduled due to dependency. [ 1247.875078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.319918] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.320157] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1252.900070] env[66919]: INFO networking_nsxv3.common.synchronization [req-c9cb21f7-d7a6-4c9b-b314-e6fe8269664b req-e8f4a57c-5557-4941-8ecc-eb91962f3f37 tempest-AttachVolumeShelveTestJSON-1745037447 tempest-AttachVolumeShelveTestJSON-1745037447-project-member] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1252.900667] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGHEST for action security_group_members [ 1252.900999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.901136] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.901204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.901410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.901553] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.901652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.901714] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.901860] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.901946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.902140] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.404635] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.404839] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.404985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.405373] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.405559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.405855] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.406050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.406195] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.406483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.406908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.406908] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be updated. [ 1253.447125] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.447277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.447340] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.447559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.447713] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.460371] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: IN_PROGRESS for 2s [ 1255.472101] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 in Status: SUCCESS [ 1255.472101] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 deletion is rescheduled due to dependency. [ 1255.472101] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.901729] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1257.902147] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1260.739505] env[66919]: INFO networking_nsxv3.common.synchronization [req-2e91d7b8-1e4b-470b-9b4c-2218b3b43e60 req-4eb8ba6f-8104-441c-aacf-70855e27e0aa tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1260.739936] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1260.740252] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.740374] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.740456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.740632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.740851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.740994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.741231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.741405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.741510] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.741608] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.768296] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.768478] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.768524] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.768750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.768861] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.244083] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.271105] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.748189] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.773554] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.250558] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.250718] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.250791] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.251034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.251140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.251261] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1262.276350] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1262.276607] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1262.289936] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.290230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.290323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.290596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.290843] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.299898] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1263.153695] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.154108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.154108] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.154205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.165318] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1263.167747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.168554] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1263.206128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.206372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.206372] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.206553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.220421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.221269] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1263.221366] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1263.221443] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1263.287111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.287265] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.287334] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.287556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.289275] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.289527] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1263.382435] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.382631] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.382690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.382898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.383214] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.383473] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1263.489803] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.490453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.490453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.490453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.490670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.491578] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1263.491578] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'482283b1-d8c6-448e-bbe8-ed71e10e6b6b', '7116cbb7-b94d-4c76-af52-903722820ea6', '9691f7e5-d5a3-4f2d-86cc-9f1494cee046', '4b46dc5c-dcd7-49a6-a2b6-31024aac0805', 'a87b0710-8423-4a57-8221-4ad054db58d7', '905c5896-f3db-4f90-ab61-b62bb3cbee86', 'e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333', 'ae47d158-58bb-4dbc-9056-ccc48ba1c99f', '2fdb353a-0a88-42ad-98f8-50760f3a6798', '365f0d7e-3740-4616-bfcb-3bab286dfb33', 'b86545e3-6fe4-40a0-b7a2-11e0ad14bf96', '12f69e0f-ba18-45e6-aa72-789adc7ed5ed', 'b0b1967b-4591-4210-b122-446732ce3041', '477edf9b-362d-4dfc-a63d-98bae4607734', 'c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e', 'b4e84c14-8146-4c6a-8c3b-882ddeeb1f72', '8a05be69-3f5e-4c39-8a1b-381e428a3950', '2d1de849-c2e6-46e2-a774-597b77be599b', 'f8993b03-159d-4cb8-a490-873c724e7d28', '538cb57d-2620-470f-a3f1-4d52589fec78', '349962c6-3abc-4bf7-9059-df3d43836eb4', 'da753667-590d-44b7-b73e-76baaab11b84', 'a49750f4-d44e-4a2c-9149-0e26c8f444f0', 'da45b7e6-efbe-4bfe-be25-61bfeb440e55', 'c38fec75-1824-4123-9a27-d70b3e15c2bc', '8de9ea36-57e3-4c37-a587-59d118b05d81', '55d7cafa-a304-4afc-9136-b32b28d8fdc3', '11de85e1-8fdb-4cd8-898c-db27313f960d', '2b279846-5f96-463a-ab8f-df707aa1a846', '865ff4e5-b005-48b2-abcb-24019b5baf5c', '25ae71be-f061-446d-96fb-cc2053e285fa', 'edb06d74-09ba-41c3-8b40-ff12c2672902', '1c70302e-70ac-434d-a62c-6cde4cb391fa', '126dbb86-4151-4c70-bb98-79a6ebd8d9c5', '10f9800a-60de-419a-9c5b-281e9c36e6e6', '872d14cf-31fb-44ed-a275-fe8a6bdf8512', 'f65ecefc-2215-4da9-a836-c6bf34b8534e', '82828762-4a66-4fd4-8d16-f6ddfbc9eb01', '07ef1b9b-e982-41f7-a4f6-a3caf8809311', 'dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5', 'af639ee4-0cf3-4378-b556-ae5617090112', '754aa366-08b4-46d7-a4e2-292d8016099c', 'e337e995-ce59-42bc-8ff2-80fd5d186e21', '6e44ceb5-d132-4c72-9fdc-3384663a523d', '63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a', 'd72e45fa-d666-4664-a812-3413fb67c0b4'} {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1263.491578] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1263.534614] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.534794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.534873] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.535145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.535232] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.535302] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1263.536050] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1263.536050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1263.631222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.631793] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.632353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.634255] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.635601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.635979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1263.636096] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1263.636162] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1263.636209] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1263.636334] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1263.636394] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGH for action security_group_rules [ 1263.636541] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1263.636541] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGH for action security_group_rules [ 1263.636656] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGH for action security_group_rules [ 1263.636656] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGH for action security_group_rules [ 1263.636731] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGH for action security_group_rules [ 1263.636781] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGH for action security_group_rules [ 1263.636854] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGH for action security_group_rules [ 1263.636916] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGH for action security_group_rules [ 1263.636976] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGH for action security_group_rules [ 1263.637049] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGH for action security_group_rules [ 1263.637131] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGH for action security_group_rules [ 1263.637200] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 1263.637262] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGH for action security_group_rules [ 1263.637323] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGH for action security_group_rules [ 1263.637383] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGH for action security_group_rules [ 1263.637459] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGH for action security_group_rules [ 1263.637850] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGH for action security_group_rules [ 1263.637850] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGH for action security_group_rules [ 1263.637850] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGH for action security_group_rules [ 1263.637850] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.312043] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1264.312992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.741621] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1265.742054] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1265.742054] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b with Priority: HIGH for action security_group_rules [ 1265.742054] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 with Priority: HIGH for action security_group_rules [ 1265.742207] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 with Priority: HIGH for action security_group_rules [ 1265.742248] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e with Priority: HIGH for action security_group_rules [ 1265.742342] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538cb57d-2620-470f-a3f1-4d52589fec78 with Priority: HIGH for action security_group_rules [ 1265.742431] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8993b03-159d-4cb8-a490-873c724e7d28 with Priority: HIGH for action security_group_rules [ 1265.742520] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d1de849-c2e6-46e2-a774-597b77be599b with Priority: HIGH for action security_group_rules [ 1265.742609] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 with Priority: HIGH for action security_group_rules [ 1265.742719] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGH for action security_group_rules [ 1265.742848] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 with Priority: HIGH for action security_group_rules [ 1265.742889] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0b1967b-4591-4210-b122-446732ce3041 with Priority: HIGH for action security_group_rules [ 1265.742951] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed with Priority: HIGH for action security_group_rules [ 1265.743056] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 with Priority: HIGH for action security_group_rules [ 1265.743187] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 with Priority: HIGH for action security_group_rules [ 1265.743283] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 with Priority: HIGH for action security_group_rules [ 1265.743369] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 with Priority: HIGH for action security_group_rules [ 1265.743455] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f with Priority: HIGH for action security_group_rules [ 1265.743540] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a87b0710-8423-4a57-8221-4ad054db58d7 with Priority: HIGH for action security_group_rules [ 1265.743625] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1265.743712] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGH for action security_group_rules [ 1265.744267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.744431] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.744539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.744767] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.744850] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('482283b1-d8c6-448e-bbe8-ed71e10e6b6b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.745873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.746643] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.746784] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.747076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.747191] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9691f7e5-d5a3-4f2d-86cc-9f1494cee046',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.749111] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.749291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.749404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.749645] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.749774] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.751590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.751715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.751760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.751929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.752182] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.752994] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-538cb57d-2620-470f-a3f1-4d52589fec78 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.753211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.753346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.753610] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.753783] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('538cb57d-2620-470f-a3f1-4d52589fec78',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.754987] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8993b03-159d-4cb8-a490-873c724e7d28 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.755245] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.755401] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.755672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.755832] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8993b03-159d-4cb8-a490-873c724e7d28',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.756597] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2d1de849-c2e6-46e2-a774-597b77be599b taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.756742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.756829] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.757022] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.757169] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2d1de849-c2e6-46e2-a774-597b77be599b',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.758215] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8a05be69-3f5e-4c39-8a1b-381e428a3950 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.758359] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.758489] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.758747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.758900] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8a05be69-3f5e-4c39-8a1b-381e428a3950',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.759902] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.760197] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.760295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.760491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.760595] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.761354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.761652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.761652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.761652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.761803] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4e84c14-8146-4c6a-8c3b-882ddeeb1f72',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.762756] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0b1967b-4591-4210-b122-446732ce3041 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.762756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.762756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.762972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.763083] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0b1967b-4591-4210-b122-446732ce3041',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.763805] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.763929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.763994] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.764209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.764320] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('12f69e0f-ba18-45e6-aa72-789adc7ed5ed',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.765040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.765314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.765314] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.765462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.765703] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b86545e3-6fe4-40a0-b7a2-11e0ad14bf96',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.766232] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-365f0d7e-3740-4616-bfcb-3bab286dfb33 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.766371] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.766460] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.766633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.766728] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('365f0d7e-3740-4616-bfcb-3bab286dfb33',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.767578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2fdb353a-0a88-42ad-98f8-50760f3a6798 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.767665] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.767847] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.768319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.768319] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2fdb353a-0a88-42ad-98f8-50760f3a6798',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.768829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-905c5896-f3db-4f90-ab61-b62bb3cbee86 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.768934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.769014] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.769171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.769243] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('905c5896-f3db-4f90-ab61-b62bb3cbee86',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.769968] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.770104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.770264] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.770321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.770391] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae47d158-58bb-4dbc-9056-ccc48ba1c99f',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.771375] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a87b0710-8423-4a57-8221-4ad054db58d7 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.771375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.771375] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.771756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.771756] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a87b0710-8423-4a57-8221-4ad054db58d7',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.772354] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.772449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.772516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.772662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.772737] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.773559] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.773559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.773559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.773781] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.773781] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.803068] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.803068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.803270] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.803312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.809699] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.809924] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.812224] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.812377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.813741] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.813864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.833950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.834125] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 482283b1-d8c6-448e-bbe8-ed71e10e6b6b is going to be deleted. [ 1265.835124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.835399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.859193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.859371] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8a05be69-3f5e-4c39-8a1b-381e428a3950 is going to be deleted. [ 1265.860594] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.860815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.878719] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.878972] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 538cb57d-2620-470f-a3f1-4d52589fec78 is going to be deleted. [ 1265.879960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.880252] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.899321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.899546] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9691f7e5-d5a3-4f2d-86cc-9f1494cee046 is going to be deleted. [ 1265.920733] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.921061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.921061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.921305] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.921454] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.921633] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8a05be69-3f5e-4c39-8a1b-381e428a3950" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.922447] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.922592] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.922703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.923056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.923056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.923256] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-482283b1-d8c6-448e-bbe8-ed71e10e6b6b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.959216] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.959446] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.959508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.959727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.959838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.960115] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-538cb57d-2620-470f-a3f1-4d52589fec78" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.990943] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.991350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.991465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.991700] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.991844] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.991913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9691f7e5-d5a3-4f2d-86cc-9f1494cee046" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.276302] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.276567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.276567] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.276760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.276939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.277063] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.277129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.277295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.277385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.277512] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.277586] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.283627] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.283882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.283882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.284131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.284274] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.284377] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.284453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.284609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.284716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.284801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.284907] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.296299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.296452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.296530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.296808] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.296990] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.297107] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.297169] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.297342] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.297427] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.297530] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.297619] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.326251] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.326482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.326560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.326770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.340935] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.341166] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.342102] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.342198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.343904] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.344051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.347299] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.347420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.367829] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.368103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.373761] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.373961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.374854] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.374950] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.375780] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.375894] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.376538] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.376672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.377684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.377789] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.379594] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1266.380142] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.380239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.381018] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1266.381554] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.381657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.388339] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1266.388872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.388999] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 365f0d7e-3740-4616-bfcb-3bab286dfb33 is going to be deleted. [ 1266.390201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.390464] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.412326] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.412326] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2d1de849-c2e6-46e2-a774-597b77be599b is going to be deleted. [ 1266.412715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.412930] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.448880] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.448880] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2fdb353a-0a88-42ad-98f8-50760f3a6798 is going to be deleted. [ 1266.449937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.449937] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.456146] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.456380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.490277] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.490420] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 12f69e0f-ba18-45e6-aa72-789adc7ed5ed is going to be deleted. [ 1266.491425] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.491686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.506586] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.506736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.542321] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.542491] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8993b03-159d-4cb8-a490-873c724e7d28 is going to be deleted. [ 1266.543392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.543625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.553088] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.553293] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.557796] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.558054] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.591456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.591680] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0b1967b-4591-4210-b122-446732ce3041 is going to be deleted. [ 1266.593017] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.593302] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.660577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.660755] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4e84c14-8146-4c6a-8c3b-882ddeeb1f72 is going to be deleted. [ 1266.662041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.662307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.664017] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.664164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.711867] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.712146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.714462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.714619] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e is going to be deleted. [ 1266.715756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.715953] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.747630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.748030] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 905c5896-f3db-4f90-ab61-b62bb3cbee86 is going to be deleted. [ 1266.749212] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.749547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.781049] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.794503] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.801523] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.801523] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.804037] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.804037] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a87b0710-8423-4a57-8221-4ad054db58d7 is going to be deleted. [ 1266.804709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.804923] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.806422] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.849945] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.850201] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b86545e3-6fe4-40a0-b7a2-11e0ad14bf96 is going to be deleted. [ 1266.851521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.851757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.890317] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.890548] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.902235] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.902453] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.903568] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.903686] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333 is going to be deleted. [ 1266.904649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.904858] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.977421] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.977690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.017942] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.018230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.019670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.019878] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae47d158-58bb-4dbc-9056-ccc48ba1c99f is going to be deleted. [ 1267.021312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.021649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.021790] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.021981] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-365f0d7e-3740-4616-bfcb-3bab286dfb33" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.022240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.022487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.022609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.022785] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2d1de849-c2e6-46e2-a774-597b77be599b" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.023527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.023771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.023898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.024119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2fdb353a-0a88-42ad-98f8-50760f3a6798" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.024327] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.024553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.024682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.024862] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-12f69e0f-ba18-45e6-aa72-789adc7ed5ed" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.025085] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.025320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.025440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.025630] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8993b03-159d-4cb8-a490-873c724e7d28" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.025875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.026301] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.026553] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.026876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0b1967b-4591-4210-b122-446732ce3041" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.027216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.027420] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.027522] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.027669] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4e84c14-8146-4c6a-8c3b-882ddeeb1f72" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.027837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.028161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.028278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.028458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-905c5896-f3db-4f90-ab61-b62bb3cbee86" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.028647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.028861] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.028998] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.029140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c003c0cf-7ef6-4c0a-9d5b-d9ba24572e5e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.029333] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.029518] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.029647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.029810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a87b0710-8423-4a57-8221-4ad054db58d7" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.030000] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.030205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.030308] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.030469] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b86545e3-6fe4-40a0-b7a2-11e0ad14bf96" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.062339] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.062566] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.062655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.062917] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.063048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.063198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e4be7fe2-79d1-4cfc-a72e-c9d46cfb6333" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.120888] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.121133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.121133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.121347] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.121470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.121655] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae47d158-58bb-4dbc-9056-ccc48ba1c99f" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.284791] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 477edf9b-362d-4dfc-a63d-98bae4607734: rpc.has_security_group_logging(os_id): False [ 1267.296676] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 1267.304525] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.304671] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.304741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.304957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.308396] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4b46dc5c-dcd7-49a6-a2b6-31024aac0805: rpc.has_security_group_logging(os_id): False [ 1267.320778] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.320915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.327253] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.327253] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.327253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.328847] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.329152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.350992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.351250] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.351470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.351470] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.352760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.352760] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.352760] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1267.353046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.353299] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.372992] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.373411] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.373527] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.373569] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.374205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.374205] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.374205] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1267.399540] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.399746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.399820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.400150] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.400417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.415868] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1267.425360] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.425360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.425508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.425695] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.425875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.433552] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.433692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.433762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.433971] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.434126] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.453690] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1267.454371] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1269.430208] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1269.430600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.474118] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1269.474361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.475127] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1269.475418] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.744481] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.744887] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1275.745467] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.745467] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1277.213080] env[66919]: INFO networking_nsxv3.common.synchronization [req-564bbfeb-897b-46a2-b186-f1d483e1c14a req-81d51dcd-fc44-4581-95d9-aeb55a2cd135 tempest-ServerActionsTestOtherA-1073906725 tempest-ServerActionsTestOtherA-1073906725-project-member] Enqueued Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1277.213702] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 with Priority: HIGHEST for action security_group_members [ 1277.214751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.214751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.214751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.214751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.214751] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.214751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.214751] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.215239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.215239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.215239] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4b46dc5c-dcd7-49a6-a2b6-31024aac0805',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.717527] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.717726] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.717780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.717999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.718111] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.718316] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.718424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.718497] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.718641] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.718715] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.718800] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 is going to be updated. [ 1277.748869] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.749036] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.749134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.749348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.749494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.759333] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: IN_PROGRESS for 2s [ 1279.771236] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 in Status: SUCCESS [ 1279.771540] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4b46dc5c-dcd7-49a6-a2b6-31024aac0805 deletion is rescheduled due to dependency. [ 1279.771540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4b46dc5c-dcd7-49a6-a2b6-31024aac0805" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.214379] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1282.214632] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.215945] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1287.216339] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.983060] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-533 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.983060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.983060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.983060] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.983530] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.983530] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.983530] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.983675] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.983799] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.984010] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.984141] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1288.984345] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1288.984535] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1288.984744] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1288.984870] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1288.985010] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1289.007234] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1289.007410] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1289.007544] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1289.007713] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-533" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.008033] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-6a3dc58c-9814-49b8-8c15-271624e2d57e taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.008218] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.008334] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.008582] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.008718] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3dc58c-9814-49b8-8c15-271624e2d57e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.511551] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.511778] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.511905] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.512216] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.512368] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.512648] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.512801] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.512918] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.513141] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.513276] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.513550] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.513700] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.513814] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.514022] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.514153] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.514296] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e is going to be updated. [ 1289.536937] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.537173] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.537299] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.537574] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.537795] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.538059] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.256774] env[66919]: INFO networking_nsxv3.common.synchronization [req-431072ce-bfbd-4732-8706-2a2937fd6bad req-89fe3591-3a08-4edb-834f-1a86aeacee20 service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1290.257064] env[66919]: INFO networking_nsxv3.common.synchronization [req-431072ce-bfbd-4732-8706-2a2937fd6bad req-89fe3591-3a08-4edb-834f-1a86aeacee20 service nova] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1290.257064] env[66919]: INFO networking_nsxv3.common.synchronization [req-431072ce-bfbd-4732-8706-2a2937fd6bad req-89fe3591-3a08-4edb-834f-1a86aeacee20 service nova] Enqueued Resource ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e with Priority: HIGHEST for action port [ 1290.257302] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_rules [ 1290.257424] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1290.257516] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e with Priority: HIGHEST for action port [ 1290.258092] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.258206] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.258288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.258488] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.258568] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.259379] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.259493] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.259560] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.259720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.259867] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.259961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.260034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.260240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.260358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.260408] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.261076] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a3dc58c-9814-49b8-8c15-271624e2d57e taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.261188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.261257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.261395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.261467] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a3dc58c-9814-49b8-8c15-271624e2d57e',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.763529] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.764738] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.764738] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.764877] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a3dc58c-9814-49b8-8c15-271624e2d57e with status ACTIVE [ 1290.765040] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.765152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.765211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.765415] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.765501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.765667] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.765759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.765820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.765964] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.766051] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.766225] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.766315] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.766397] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.766556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.766628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.766706] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a3dc58c-9814-49b8-8c15-271624e2d57e is going to be updated. [ 1290.786784] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.786997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.786997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.787189] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.787320] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.787465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a3dc58c-9814-49b8-8c15-271624e2d57e" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.269104] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1291.771372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.771623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.771623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.771857] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.771946] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.772069] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1291.802881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.803073] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.803124] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.803343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.803484] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.813841] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1293.824804] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1293.825182] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.825234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.825448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.825640] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.825753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.825817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.825969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.826060] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.826142] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.826229] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.328479] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.830547] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7116cbb7-b94d-4c76-af52-903722820ea6: rpc.has_security_group_logging(os_id): False [ 1294.854167] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.854410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.854410] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.854625] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.854716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.855013] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.855133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.855225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.855501] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.855672] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.855783] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1294.924798] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.924985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.925067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.925421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.925504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.950472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1295.258684] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1295.258914] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1296.977398] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1296.977398] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.066621] env[66919]: INFO networking_nsxv3.common.synchronization [req-0cbb658c-c60a-49ce-99c5-262ebc35445f req-51ccecb8-766c-4970-b8ee-9530cd94c1ce tempest-AttachVolumeNegativeTest-305668561 tempest-AttachVolumeNegativeTest-305668561-project-member] Enqueued Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1298.067420] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d with Priority: HIGHEST for action security_group_members [ 1298.067582] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e44ceb5-d132-4c72-9fdc-3384663a523d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.067682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.067736] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.068086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.068086] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.068267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.068267] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.068388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.068468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.068562] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e44ceb5-d132-4c72-9fdc-3384663a523d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1298.571638] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.571928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.571928] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.572116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.595389] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.595659] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.595787] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.595828] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.596053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.596140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.596231] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d is going to be updated. [ 1298.624881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.625140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.625140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.625356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.625504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.635875] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: IN_PROGRESS for 2s [ 1300.649071] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d in Status: SUCCESS [ 1300.649537] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e44ceb5-d132-4c72-9fdc-3384663a523d deletion is rescheduled due to dependency. [ 1300.649537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e44ceb5-d132-4c72-9fdc-3384663a523d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.068041] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.068358] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.439599] env[66919]: INFO networking_nsxv3.common.synchronization [req-6f1dd795-ca5e-4a12-84a3-d4f822c7099f req-4e61c32a-5d74-45d5-9bd3-ed3719bfa042 tempest-ServerActionsTestOtherB-1544007993 tempest-ServerActionsTestOtherB-1544007993-project-member] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1305.440156] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGHEST for action security_group_members [ 1305.440782] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.440901] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.440972] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.441191] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.441372] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.441504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.441574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.441746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.441835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.441930] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.944304] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.944515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.944559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.945273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.945434] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.945674] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.945805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.945891] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.946112] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.946216] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.946330] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be updated. [ 1305.977014] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.977211] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.977282] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.977537] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.977720] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.986529] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: IN_PROGRESS for 2s [ 1307.998402] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7116cbb7-b94d-4c76-af52-903722820ea6 in Status: SUCCESS [ 1307.998802] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 deletion is rescheduled due to dependency. [ 1307.998802] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.441706] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.442103] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1315.442447] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.442447] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.443594] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.443594] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.444911] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.444911] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.445816] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.446214] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.446979] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.447359] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.288741] env[66919]: INFO networking_nsxv3.common.synchronization [None req-79eedd73-b253-4814-a50d-d29e14e401a1 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1337.289247] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1337.289544] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.289664] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.289730] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.289997] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.290093] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.364299] env[66919]: INFO networking_nsxv3.common.synchronization [None req-23ffa4de-4df6-47b1-bf9c-6e209ac941ec tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1337.364762] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1337.365070] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.365173] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.809340] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.809547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.809547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.809741] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.809835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.809932] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 already deleted. [ 1337.810044] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.810179] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.810336] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.810419] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.329881] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.330365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.330365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.330365] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.330472] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.330472] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 already deleted. [ 1338.330663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.366121] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1342.366403] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1342.611258] env[66919]: INFO networking_nsxv3.common.synchronization [req-2cae16c8-22dd-40d4-a892-17c4b5ce1c90 req-b2599762-cc79-4cfe-9e58-155007655961 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1342.611786] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1342.612106] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.612233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.612329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.612589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.612748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.612874] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.612922] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.613056] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.613141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.613234] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.884565] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.884763] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.884886] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.885170] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.885429] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.885581] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.885695] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.885909] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.886062] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.886267] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.886377] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1342.886482] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1342.886586] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1342.886693] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1342.886837] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1342.886953] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1342.906828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1342.906996] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1342.907124] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1342.907289] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.907590] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-09d1577f-667a-4c94-a692-3183beb4b5fd taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.907758] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.907877] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.908212] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.908355] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d1577f-667a-4c94-a692-3183beb4b5fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.115597] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.115811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.115811] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.116033] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.116116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.116283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.116385] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.116448] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.116603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.116709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.116764] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 already deleted. [ 1343.116841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.410945] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.411265] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.411311] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.411578] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.411719] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.411872] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port 09d1577f-667a-4c94-a692-3183beb4b5fd not found, creating... [ 1343.412139] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.412291] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.412407] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.412620] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.412755] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.413053] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.413220] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.413336] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.413537] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.413665] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.413800] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: 09d1577f-667a-4c94-a692-3183beb4b5fd is going to be created. [ 1343.436163] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.436367] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.436491] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.436761] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.436991] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.437227] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.115939] env[66919]: INFO networking_nsxv3.common.synchronization [req-2cae16c8-22dd-40d4-a892-17c4b5ce1c90 req-633fd863-f72c-4d31-885e-c5b1915b97aa service nova] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1344.116207] env[66919]: INFO networking_nsxv3.common.synchronization [req-2cae16c8-22dd-40d4-a892-17c4b5ce1c90 req-633fd863-f72c-4d31-885e-c5b1915b97aa service nova] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1344.116360] env[66919]: INFO networking_nsxv3.common.synchronization [req-2cae16c8-22dd-40d4-a892-17c4b5ce1c90 req-633fd863-f72c-4d31-885e-c5b1915b97aa service nova] Enqueued Resource ID: 09d1577f-667a-4c94-a692-3183beb4b5fd with Priority: HIGHEST for action port [ 1344.116589] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_rules [ 1344.116708] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1344.116799] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09d1577f-667a-4c94-a692-3183beb4b5fd with Priority: HIGHEST for action port [ 1344.117414] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.117535] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.117600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.117794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.117896] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.118688] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.118798] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.118906] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.119038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.119177] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.119269] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.119332] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.119463] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.120662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.120662] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.120662] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-09d1577f-667a-4c94-a692-3183beb4b5fd taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.120662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.120662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.120662] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.120662] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09d1577f-667a-4c94-a692-3183beb4b5fd',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.623301] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.623624] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.625329] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1344.626272] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 09d1577f-667a-4c94-a692-3183beb4b5fd with status ACTIVE [ 1344.626439] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.626556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.626619] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.626819] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.627380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.627518] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.627599] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.627642] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.627780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.627863] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.628165] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.628284] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.628350] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.628496] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.628609] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.628656] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 09d1577f-667a-4c94-a692-3183beb4b5fd is going to be updated. [ 1344.652519] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.652743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.652743] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.652913] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.653064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.653220] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09d1577f-667a-4c94-a692-3183beb4b5fd" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.132479] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.634612] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.634952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.634952] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.635092] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.635188] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.635286] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 is going to be created. [ 1345.657303] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.657555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.657555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.657722] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.657845] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.666769] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: UNINITIALIZED for 2s [ 1347.677796] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: SUCCESS [ 1347.678239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.678239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.678239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.678473] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.678647] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.678710] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.678813] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.678893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.678974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.679075] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.181958] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1348.683943] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f778fb7a-5898-4e15-9d81-2ba9685c9850: rpc.has_security_group_logging(os_id): False [ 1348.701323] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.701534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.701534] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.701682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.701771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.702022] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.702127] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.702194] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.702344] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.702421] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.702508] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 is going to be created. [ 1348.760500] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.760756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.760756] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.760969] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.761167] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.773167] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: IN_PROGRESS for 2s [ 1349.118298] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1349.118527] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1350.785679] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: SUCCESS [ 1350.786143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.119152] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1354.119509] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.120771] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1359.121168] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1364.121800] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.122269] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1369.123147] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1369.123525] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1374.124649] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1374.124649] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1379.125638] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1379.125638] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1384.126561] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1384.126932] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1389.127898] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1389.128381] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1394.128925] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1394.129334] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1399.130051] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1399.130494] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1404.130943] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1404.131431] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1409.131665] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1409.132268] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1414.132920] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1414.133275] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1419.134346] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1419.134716] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1424.135803] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1424.135803] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1429.137132] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.137485] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.247664] env[66919]: INFO networking_nsxv3.common.synchronization [req-564266bf-8270-4f9b-ade5-5d2117e061b9 req-a7291ca6-1408-49ff-8004-b283e6fbcb32 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1430.249049] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGHEST for action security_group_members [ 1430.249653] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.249890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.250010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.250323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.250599] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.250794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.250939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.251201] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.251343] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.251514] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1430.754480] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.754712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.754712] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.754926] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.755034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.755240] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.755349] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.755413] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.755574] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.755652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.755740] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 is going to be updated. [ 1430.792778] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1430.793061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1430.793061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1430.793263] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1430.793407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1430.803502] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: IN_PROGRESS for 2s [ 1432.814383] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 in Status: SUCCESS [ 1432.814701] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 deletion is rescheduled due to dependency. [ 1432.814701] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.250096] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.250381] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1440.250959] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.251399] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.251725] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.252133] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.252584] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.252969] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.253524] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.253932] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1460.254572] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1460.254959] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1464.567364] env[66919]: INFO networking_nsxv3.common.synchronization [req-0647bb17-8d94-42e4-aa34-c8b85c7acffd req-f2ca01a3-8910-42fb-81dd-8339449ad2b9 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1464.567924] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1464.568239] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.568362] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.568432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.568670] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.568883] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1464.568995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1464.569266] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1464.569578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1464.569653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1464.569736] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1465.073073] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.073288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.073288] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.073494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.073582] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.073773] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.073867] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.073925] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.074094] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.074163] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.074254] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1465.101128] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1465.101356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1465.101356] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1465.101531] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1465.101649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1465.110385] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1467.122556] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1467.122936] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 deletion is rescheduled due to dependency. [ 1467.122936] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1469.568902] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1469.569354] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.520906] env[66919]: INFO networking_nsxv3.common.synchronization [req-14e56a9d-3a02-4177-b372-1e9cd7d6943e req-f9f24d9f-6f08-41f9-b3d8-0cfa96f4acb0 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1471.521498] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1471.521752] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.521898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.521947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.522141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.522348] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.522516] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.522554] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.522716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.522805] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.522897] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1471.822285] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.822487] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.822611] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.822868] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.823129] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.823285] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.823397] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.823639] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.823786] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.824013] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1471.824131] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1471.824238] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1471.824346] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1471.824450] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1471.824551] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1471.824678] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1471.846575] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1471.846743] env[66919]: DEBUG dogpile.cache.region [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1471.846857] env[66919]: DEBUG dogpile.lock [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1471.846994] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1471.847317] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock port-5b9e805a-dd60-44af-91ec-20c86610c989 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1471.847483] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1471.847598] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1471.847931] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1471.848085] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9e805a-dd60-44af-91ec-20c86610c989',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1472.025199] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.025417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.025417] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.025613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.025709] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.025897] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.025999] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.026074] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.026230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.026311] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.026396] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1472.051676] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.051887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.051887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.052061] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.052198] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.061421] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1472.350089] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.350329] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.350429] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.350712] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.350859] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.351020] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Segment Port 5b9e805a-dd60-44af-91ec-20c86610c989 not found, creating... [ 1472.351383] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.351555] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.351673] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.351895] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.352043] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.352488] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.352575] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.352657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.352864] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.352996] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.353155] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Resource: SegmentPort with ID: 5b9e805a-dd60-44af-91ec-20c86610c989 is going to be created. [ 1472.374648] env[66919]: DEBUG networking_nsxv3.common.locking [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1472.374852] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1472.374959] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1472.375254] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1472.375543] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1472.375774] env[66919]: DEBUG oslo_concurrency.lockutils [None req-dfa52d01-11e5-463d-b83b-b5ba1cd10f1f None None] Releasing lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.468649] env[66919]: INFO networking_nsxv3.common.synchronization [req-14e56a9d-3a02-4177-b372-1e9cd7d6943e req-0c2068c8-37dd-44a1-acf7-4d531ae826da service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1473.468939] env[66919]: INFO networking_nsxv3.common.synchronization [req-14e56a9d-3a02-4177-b372-1e9cd7d6943e req-0c2068c8-37dd-44a1-acf7-4d531ae826da service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1473.468988] env[66919]: INFO networking_nsxv3.common.synchronization [req-14e56a9d-3a02-4177-b372-1e9cd7d6943e req-0c2068c8-37dd-44a1-acf7-4d531ae826da service nova] Enqueued Resource ID: 5b9e805a-dd60-44af-91ec-20c86610c989 with Priority: HIGHEST for action port [ 1473.469206] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1473.469353] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1473.469450] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b9e805a-dd60-44af-91ec-20c86610c989 with Priority: HIGHEST for action port [ 1473.469998] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.470395] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.470477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.470657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.470737] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.471593] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.471675] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.472012] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b9e805a-dd60-44af-91ec-20c86610c989 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.472012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.472012] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.472230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.472330] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b9e805a-dd60-44af-91ec-20c86610c989',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1473.974263] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.974544] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.974624] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5b9e805a-dd60-44af-91ec-20c86610c989 with status ACTIVE [ 1473.974766] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.974864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.975192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.975192] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.975261] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.975433] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.975539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.975539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.975696] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.975765] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.975939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.976035] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.976095] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.976253] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.976357] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.976460] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5b9e805a-dd60-44af-91ec-20c86610c989 is going to be updated. [ 1473.998064] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1473.998064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1473.998064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1473.998423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1473.998423] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1473.998528] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b9e805a-dd60-44af-91ec-20c86610c989" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.072686] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1474.072878] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 deletion is rescheduled due to dependency. [ 1474.073041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.073133] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.073348] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.073543] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.073644] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.073721] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.073837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.073916] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.074018] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1474.576088] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.078862] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.580944] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.581426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.581426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.581426] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.581552] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.581617] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1475.609839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.610048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.610048] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.610240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.610376] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.618427] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1477.630796] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1477.631262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.631329] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.631549] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.631774] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1477.631941] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1477.632076] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1477.632307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1477.632407] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.632532] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1477.632650] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.135404] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1478.470657] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.470848] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1478.637414] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 477edf9b-362d-4dfc-a63d-98bae4607734: rpc.has_security_group_logging(os_id): False [ 1478.655361] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.655517] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.655586] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.655796] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.655885] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.656144] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.656243] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.656307] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.656458] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.657026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.657026] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1478.715918] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1478.716168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1478.716168] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1478.716330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1478.716474] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1478.727937] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1479.828224] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1479.828621] env[66919]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-40b8bd55-5429-4fc0-96e1-55279365b5b3 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1480.742979] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1480.743239] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1483.472380] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.472380] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.473705] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.474137] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.475248] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.475704] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.476144] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.476850] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.769114] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1500.769515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1500.769515] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1500.769598] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1500.769670] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.271721] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1501.774622] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1502.277571] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1502.277779] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1503.029190] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.029651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.029651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.029651] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.177951] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1503.178809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.179961] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1503.216214] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.216443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.216443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.216622] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.230276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.231105] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1503.231187] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1503.231292] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1503.263082] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.263294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.263294] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.263509] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.264310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.264458] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1503.335465] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.335674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.335674] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.335820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.336138] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.336409] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1503.409684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.409684] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.410021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.410021] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.410295] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.410643] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:30. [ 1503.410736] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7116cbb7-b94d-4c76-af52-903722820ea6', '349962c6-3abc-4bf7-9059-df3d43836eb4', 'da753667-590d-44b7-b73e-76baaab11b84', 'a49750f4-d44e-4a2c-9149-0e26c8f444f0', 'da45b7e6-efbe-4bfe-be25-61bfeb440e55', '8de9ea36-57e3-4c37-a587-59d118b05d81', 'c38fec75-1824-4123-9a27-d70b3e15c2bc', '55d7cafa-a304-4afc-9136-b32b28d8fdc3', 'f778fb7a-5898-4e15-9d81-2ba9685c9850', '11de85e1-8fdb-4cd8-898c-db27313f960d', '2b279846-5f96-463a-ab8f-df707aa1a846', '25ae71be-f061-446d-96fb-cc2053e285fa', '865ff4e5-b005-48b2-abcb-24019b5baf5c', '1c70302e-70ac-434d-a62c-6cde4cb391fa', 'edb06d74-09ba-41c3-8b40-ff12c2672902', '126dbb86-4151-4c70-bb98-79a6ebd8d9c5', '10f9800a-60de-419a-9c5b-281e9c36e6e6', 'd72e45fa-d666-4664-a812-3413fb67c0b4', '477edf9b-362d-4dfc-a63d-98bae4607734', '872d14cf-31fb-44ed-a275-fe8a6bdf8512', 'f65ecefc-2215-4da9-a836-c6bf34b8534e', '82828762-4a66-4fd4-8d16-f6ddfbc9eb01', '07ef1b9b-e982-41f7-a4f6-a3caf8809311', 'dfbf8f2c-7954-4cd0-9ef9-9a823a8cf4d5', 'af639ee4-0cf3-4378-b556-ae5617090112', '754aa366-08b4-46d7-a4e2-292d8016099c', 'e337e995-ce59-42bc-8ff2-80fd5d186e21', '6e44ceb5-d132-4c72-9fdc-3384663a523d', '63cea2b9-6bcd-4f56-bbb6-63b48ee8e85a', '4b46dc5c-dcd7-49a6-a2b6-31024aac0805'} {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1503.410862] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1503.428576] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.428825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.428825] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.428961] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.429062] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.429171] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1503.429231] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1503.429303] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1503.477752] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.477946] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1503.503500] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1503.503750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1503.503750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1503.503910] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1503.505078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1503.505341] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1503.505423] env[66919]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66919) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1503.505497] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1503.505556] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1503.505633] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/30 resources of Type:Security Group Rules [ 1503.505711] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1503.505939] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGH for action security_group_rules [ 1503.505939] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGH for action security_group_rules [ 1503.505939] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGH for action security_group_rules [ 1503.506072] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGH for action security_group_rules [ 1503.506072] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGH for action security_group_rules [ 1503.506072] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGH for action security_group_rules [ 1503.506172] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGH for action security_group_rules [ 1503.506206] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGH for action security_group_rules [ 1503.506243] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGH for action security_group_rules [ 1503.506335] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGH for action security_group_rules [ 1503.506390] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGH for action security_group_rules [ 1503.506442] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGH for action security_group_rules [ 1503.506493] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGH for action security_group_rules [ 1503.506542] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGH for action security_group_rules [ 1503.506592] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGH for action security_group_rules [ 1503.506640] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGH for action security_group_rules [ 1503.506692] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGH for action security_group_rules [ 1503.506739] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGH for action security_group_rules [ 1503.506787] env[66919]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGH for action security_group_rules [ 1503.506883] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.478792] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.479174] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1508.479174] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7116cbb7-b94d-4c76-af52-903722820ea6 with Priority: HIGH for action security_group_rules [ 1508.479174] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da753667-590d-44b7-b73e-76baaab11b84 with Priority: HIGH for action security_group_rules [ 1508.479342] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c38fec75-1824-4123-9a27-d70b3e15c2bc with Priority: HIGH for action security_group_rules [ 1508.479384] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edb06d74-09ba-41c3-8b40-ff12c2672902 with Priority: HIGH for action security_group_rules [ 1508.479453] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 with Priority: HIGH for action security_group_rules [ 1508.479863] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGH for action security_group_rules [ 1508.479973] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72e45fa-d666-4664-a812-3413fb67c0b4 with Priority: HIGH for action security_group_rules [ 1508.480080] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 with Priority: HIGH for action security_group_rules [ 1508.480217] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa with Priority: HIGH for action security_group_rules [ 1508.480350] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 with Priority: HIGH for action security_group_rules [ 1508.480441] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c with Priority: HIGH for action security_group_rules [ 1508.480527] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ae71be-f061-446d-96fb-cc2053e285fa with Priority: HIGH for action security_group_rules [ 1508.480611] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b279846-5f96-463a-ab8f-df707aa1a846 with Priority: HIGH for action security_group_rules [ 1508.480696] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11de85e1-8fdb-4cd8-898c-db27313f960d with Priority: HIGH for action security_group_rules [ 1508.480781] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 with Priority: HIGH for action security_group_rules [ 1508.480868] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 with Priority: HIGH for action security_group_rules [ 1508.480952] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 with Priority: HIGH for action security_group_rules [ 1508.481049] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 with Priority: HIGH for action security_group_rules [ 1508.481135] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 with Priority: HIGH for action security_group_rules [ 1508.481221] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 with Priority: HIGH for action security_group_rules [ 1508.481684] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7116cbb7-b94d-4c76-af52-903722820ea6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.481840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.481911] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.482083] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.482203] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7116cbb7-b94d-4c76-af52-903722820ea6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.483150] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da753667-590d-44b7-b73e-76baaab11b84 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.483262] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.483328] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.483513] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.483589] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da753667-590d-44b7-b73e-76baaab11b84',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.484323] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c38fec75-1824-4123-9a27-d70b3e15c2bc taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.484440] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.484487] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.484620] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.484690] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c38fec75-1824-4123-9a27-d70b3e15c2bc',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.485547] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edb06d74-09ba-41c3-8b40-ff12c2672902 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.485616] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.485663] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.485780] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.485852] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edb06d74-09ba-41c3-8b40-ff12c2672902',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.486521] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.486623] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.486686] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.486833] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.486903] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('872d14cf-31fb-44ed-a275-fe8a6bdf8512',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.487578] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.487679] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.487735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.487888] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.487960] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.488727] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d72e45fa-d666-4664-a812-3413fb67c0b4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.488832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.488898] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.489059] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.489133] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d72e45fa-d666-4664-a812-3413fb67c0b4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.489815] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10f9800a-60de-419a-9c5b-281e9c36e6e6 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.489919] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.489984] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.490145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.490213] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10f9800a-60de-419a-9c5b-281e9c36e6e6',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.490851] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c70302e-70ac-434d-a62c-6cde4cb391fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.490947] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.491031] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.491178] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.491280] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c70302e-70ac-434d-a62c-6cde4cb391fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.491923] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.492038] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.492103] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.492251] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.492321] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('126dbb86-4151-4c70-bb98-79a6ebd8d9c5',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.493057] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-865ff4e5-b005-48b2-abcb-24019b5baf5c taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.493164] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.493231] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.493399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.493475] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('865ff4e5-b005-48b2-abcb-24019b5baf5c',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.494124] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ae71be-f061-446d-96fb-cc2053e285fa taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.494221] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.494296] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.494445] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.494515] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ae71be-f061-446d-96fb-cc2053e285fa',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.495419] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b279846-5f96-463a-ab8f-df707aa1a846 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.495419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.495419] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.495639] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.495639] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b279846-5f96-463a-ab8f-df707aa1a846',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.497730] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11de85e1-8fdb-4cd8-898c-db27313f960d taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.497856] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.497907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.498096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.498171] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11de85e1-8fdb-4cd8-898c-db27313f960d',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.498749] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f778fb7a-5898-4e15-9d81-2ba9685c9850 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.498887] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.498939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.499098] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.499379] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f778fb7a-5898-4e15-9d81-2ba9685c9850',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.499819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8de9ea36-57e3-4c37-a587-59d118b05d81 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.499915] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.500536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.500536] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.500536] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8de9ea36-57e3-4c37-a587-59d118b05d81',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.500839] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.500942] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.501011] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.501580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.501580] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55d7cafa-a304-4afc-9136-b32b28d8fdc3',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.501999] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.502116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.502438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.502438] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.502438] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da45b7e6-efbe-4bfe-be25-61bfeb440e55',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.503032] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-349962c6-3abc-4bf7-9059-df3d43836eb4 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.503134] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.503649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.503649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.503649] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('349962c6-3abc-4bf7-9059-df3d43836eb4',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.504049] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.504158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.504224] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.504380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.504452] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a49750f4-d44e-4a2c-9149-0e26c8f444f0',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1508.532919] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.533078] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.533152] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.533360] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.535155] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.535155] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.557118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.557283] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da753667-590d-44b7-b73e-76baaab11b84 is going to be deleted. [ 1508.558140] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.558352] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.581697] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.581955] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7116cbb7-b94d-4c76-af52-903722820ea6 is going to be deleted. [ 1508.628744] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.628979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.628979] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.629209] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.629310] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.629432] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da753667-590d-44b7-b73e-76baaab11b84" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.639549] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1508.639753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1508.639753] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1508.639934] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1508.640034] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1508.640154] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7116cbb7-b94d-4c76-af52-903722820ea6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.021048] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.021322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.021322] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.021483] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.021650] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.021752] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.021816] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.021967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.022068] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.022158] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.022263] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.075301] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.075533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.075533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.075727] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.077462] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.077575] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.078289] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.078379] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.079085] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.079183] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.089850] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.090053] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.094267] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.094428] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.095112] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.095208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.095590] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.095698] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.096471] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.096565] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.097265] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.097361] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.098016] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.098118] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.098749] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.099162] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.099281] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.099865] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.100320] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.100414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.100997] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.101454] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.101539] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.102140] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.102598] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.102693] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.103275] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.103676] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.103790] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b279846-5f96-463a-ab8f-df707aa1a846 is going to be deleted. [ 1509.104660] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.104872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.106360] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.106456] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.107474] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.107564] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.130693] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1509.131273] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.131403] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 865ff4e5-b005-48b2-abcb-24019b5baf5c is going to be deleted. [ 1509.132386] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.132604] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.169364] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.169572] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c70302e-70ac-434d-a62c-6cde4cb391fa is going to be deleted. [ 1509.170578] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.170801] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.212819] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.213046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.227691] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.227854] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c38fec75-1824-4123-9a27-d70b3e15c2bc is going to be deleted. [ 1509.228742] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.228955] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.230359] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.230468] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.292050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.292233] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 872d14cf-31fb-44ed-a275-fe8a6bdf8512 is going to be deleted. [ 1509.293193] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.293416] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.294873] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.294985] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.368330] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.368511] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 349962c6-3abc-4bf7-9059-df3d43836eb4 is going to be deleted. [ 1509.369547] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.369762] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.408228] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.408465] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.460119] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.460309] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10f9800a-60de-419a-9c5b-281e9c36e6e6 is going to be deleted. [ 1509.461240] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.461479] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.529349] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1509.532248] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.532405] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.551689] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.551931] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edb06d74-09ba-41c3-8b40-ff12c2672902 is going to be deleted. [ 1509.552711] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.552929] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.600891] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.601199] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.640824] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.641051] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da45b7e6-efbe-4bfe-be25-61bfeb440e55 is going to be deleted. [ 1509.641962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.642204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.662939] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.663215] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.742838] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.743070] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 126dbb86-4151-4c70-bb98-79a6ebd8d9c5 is going to be deleted. [ 1509.743908] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.744148] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.824135] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.824387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.863161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.863346] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8de9ea36-57e3-4c37-a587-59d118b05d81 is going to be deleted. [ 1509.864237] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.864482] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.908314] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.908576] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1509.958010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1509.958214] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a49750f4-d44e-4a2c-9149-0e26c8f444f0 is going to be deleted. [ 1509.959129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1509.959387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1509.980272] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1509.980477] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.031801] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 477edf9b-362d-4dfc-a63d-98bae4607734: rpc.has_security_group_logging(os_id): False [ 1510.196872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.197106] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f778fb7a-5898-4e15-9d81-2ba9685c9850 is going to be deleted. [ 1510.197890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.198129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.218256] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.218467] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.222075] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.222298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.311815] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.312056] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55d7cafa-a304-4afc-9136-b32b28d8fdc3 is going to be deleted. [ 1510.312977] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.313228] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.399848] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.400141] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.415810] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.416052] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ae71be-f061-446d-96fb-cc2053e285fa is going to be deleted. [ 1510.416893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.417146] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.491450] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.491614] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.513796] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.514104] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.532392] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.532828] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11de85e1-8fdb-4cd8-898c-db27313f960d is going to be deleted. [ 1510.533596] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.533809] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.671915] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.672156] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.674757] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.674924] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d72e45fa-d666-4664-a812-3413fb67c0b4 is going to be deleted. [ 1510.675995] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.676283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.676384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.676559] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-865ff4e5-b005-48b2-abcb-24019b5baf5c" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.676759] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.676957] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.677096] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.677225] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b279846-5f96-463a-ab8f-df707aa1a846" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.677840] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.678046] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.678171] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.678300] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c70302e-70ac-434d-a62c-6cde4cb391fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.678494] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.678661] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.678771] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.678931] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c38fec75-1824-4123-9a27-d70b3e15c2bc" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.679143] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.679317] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.679452] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.679629] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-872d14cf-31fb-44ed-a275-fe8a6bdf8512" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.679795] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.679990] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.680088] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.680247] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-349962c6-3abc-4bf7-9059-df3d43836eb4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.680393] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.680584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.680666] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.680817] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10f9800a-60de-419a-9c5b-281e9c36e6e6" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.680967] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.681170] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.681283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.681449] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edb06d74-09ba-41c3-8b40-ff12c2672902" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.681649] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.681770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.681854] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.681974] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da45b7e6-efbe-4bfe-be25-61bfeb440e55" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.682113] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.682283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.682363] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.682653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-126dbb86-4151-4c70-bb98-79a6ebd8d9c5" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.682653] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.682735] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.682778] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.682893] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8de9ea36-57e3-4c37-a587-59d118b05d81" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.683026] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.683177] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.726622] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.726837] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.752872] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.753199] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.753298] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.753366] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.753580] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.753648] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.753747] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1510.754841] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.755030] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.755116] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.755234] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a49750f4-d44e-4a2c-9149-0e26c8f444f0" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.755358] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.755504] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.755579] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.755692] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f778fb7a-5898-4e15-9d81-2ba9685c9850" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.755835] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.756009] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.756093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.756203] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55d7cafa-a304-4afc-9136-b32b28d8fdc3" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.756319] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.756459] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.756533] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.756632] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ae71be-f061-446d-96fb-cc2053e285fa" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.757208] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.757368] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.757491] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.757555] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11de85e1-8fdb-4cd8-898c-db27313f960d" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.842956] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.843190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.843190] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.843399] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.843492] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.843603] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d72e45fa-d666-4664-a812-3413fb67c0b4" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1510.958311] env[66919]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1510.959026] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1510.959161] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1510.959233] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1510.959443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1510.959583] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.010355] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1513.036525] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1513.036966] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1513.482081] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1513.482306] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1518.482925] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1518.483291] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1523.484382] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1523.484789] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1528.486163] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.486555] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1533.487645] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.487645] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.488831] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.489262] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.490188] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.490649] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.491276] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.491660] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1552.057997] env[66919]: INFO networking_nsxv3.common.synchronization [req-59c58c59-7ff0-4dd6-8750-c2e3a3180a34 req-2a284417-2205-400a-8887-c84fa09b9c8a tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1552.058591] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1552.058933] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.059303] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.059387] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.059590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.059745] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.060508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.060508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.060508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.060508] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.060508] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1552.562162] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.562404] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.562462] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.562652] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.562747] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.562955] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.563067] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.563129] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.563278] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.563353] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.563440] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1552.615660] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1552.615882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1552.615882] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1552.616110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1552.616276] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1552.625626] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1554.637915] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1554.638346] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 deletion is rescheduled due to dependency. [ 1554.638346] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1557.060056] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1557.060480] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.069024] env[66919]: INFO networking_nsxv3.common.synchronization [req-c9b565a2-e2e7-44bf-836b-73164f7c2919 req-8a2a8c0b-2ead-41a4-a2f5-a33a4c13814e tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1559.069734] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1559.069734] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.069832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.069875] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.070864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.070864] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.070864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.070864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.070864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.070864] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.072478] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.335658] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.335866] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.335989] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.336296] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.336564] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.336717] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.336829] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.337050] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.337197] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.337423] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1559.337532] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] NeedRegenerationException {{(pid=66919) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1559.337640] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] no value, waiting for create lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1559.337762] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] value creation lock acquired {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1559.337871] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] No value present for key: 'zone-id' {{(pid=66919) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1559.337975] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Calling creation function for not-yet-present value {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1559.338114] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1559.360785] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1559.360954] env[66919]: DEBUG dogpile.cache.region [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66919) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1559.361079] env[66919]: DEBUG dogpile.lock [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Released creation lock {{(pid=66919) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1559.361300] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "network-166" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.361614] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef taken with stack trace [, , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.361803] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.361880] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.362292] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.362429] env[66919]: DEBUG networking_nsxv3.api.rpc [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1559.573580] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.573794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.573794] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.573976] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.574091] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.574283] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.574388] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.574443] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.574584] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.574657] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.574741] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1559.602319] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.602542] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.602595] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.602766] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.602907] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.615032] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1559.864913] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.865195] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.865263] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.865514] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.865664] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.865815] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Segment Port b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef not found, creating... [ 1559.866084] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.866243] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.866357] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.866565] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.866718] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.866972] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.867137] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.867249] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.867448] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.867575] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.867710] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Resource: SegmentPort with ID: b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef is going to be created. [ 1559.892322] env[66919]: DEBUG networking_nsxv3.common.locking [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1559.892552] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1559.892657] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1559.892927] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1559.893183] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1559.893394] env[66919]: DEBUG oslo_concurrency.lockutils [None req-8aeccf21-c4b4-4de8-ab01-418e0927efe5 None None] Releasing lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [req-c9b565a2-e2e7-44bf-836b-73164f7c2919 req-9355b5ad-73b0-4597-a25e-0a6566c49544 service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [req-c9b565a2-e2e7-44bf-836b-73164f7c2919 req-9355b5ad-73b0-4597-a25e-0a6566c49544 service nova] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [req-c9b565a2-e2e7-44bf-836b-73164f7c2919 req-9355b5ad-73b0-4597-a25e-0a6566c49544 service nova] Enqueued Resource ID: b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef with Priority: HIGHEST for action port [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_rules [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1560.562345] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef with Priority: HIGHEST for action port [ 1560.562345] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock rules-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.562960] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.563159] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.563597] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.563785] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1560.564820] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.565050] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.565344] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1560.565589] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1560.565744] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1560.566601] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1560.566601] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1561.067696] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.067834] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.068050] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef with status ACTIVE [ 1561.068222] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.068331] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.068396] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.068602] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.068690] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.068859] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.068944] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.069016] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.069204] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.069283] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.069464] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.069556] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.069613] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.069750] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.069820] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.069900] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef is going to be updated. [ 1561.093731] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.094041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.094041] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.094230] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.094312] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.094414] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7cee0e5-edb0-4e8f-a71b-85c9ce9649ef" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.632844] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1561.633217] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 deletion is rescheduled due to dependency. [ 1561.633217] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.633323] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.633540] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.633729] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1561.633842] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1561.633904] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1561.634064] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1561.634145] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1561.634238] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.137089] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1562.640090] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1563.141562] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.141716] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.141786] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.142010] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.142110] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.142213] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1563.171673] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1563.171876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1563.171876] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1563.172114] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1563.172289] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1563.182275] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1565.193439] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1565.193822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.193822] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.193962] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.194175] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1565.194380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1565.194380] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1565.194521] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1565.194600] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.194682] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1565.194795] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1565.562466] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1565.562573] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1565.696750] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1566.199197] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 477edf9b-362d-4dfc-a63d-98bae4607734: rpc.has_security_group_logging(os_id): False [ 1566.216865] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.217081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.217081] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.217291] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.217384] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.217667] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.217770] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.217832] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.217989] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.218086] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.218173] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1566.281333] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1566.281590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1566.281590] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1566.281746] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1566.281896] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1566.315790] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1568.330883] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1568.331309] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1570.563460] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1570.563840] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1575.564827] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1575.565237] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1580.565673] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1580.566113] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1585.567408] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1585.567408] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1590.568670] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1590.569127] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1595.569899] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1595.570359] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1600.571457] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1600.572056] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1605.572265] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1605.572662] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1610.573676] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1610.573676] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1615.574743] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1615.575101] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1619.285889] env[66919]: INFO networking_nsxv3.common.synchronization [req-507de36d-7a6d-4d8b-b63b-09d55ed76c71 req-61c85122-36a0-4a27-9af9-3189f7e7d0e5 tempest-ServerActionsTestJSON-1785478252 tempest-ServerActionsTestJSON-1785478252-project-member] Enqueued Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1619.286447] env[66919]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 477edf9b-362d-4dfc-a63d-98bae4607734 with Priority: HIGHEST for action security_group_members [ 1619.286748] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock member-477edf9b-362d-4dfc-a63d-98bae4607734 taken with stack trace [, , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.287102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.287102] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.287274] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.287338] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.287424] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.287490] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.287628] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.287703] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.287784] env[66919]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('477edf9b-362d-4dfc-a63d-98bae4607734',) {} {{(pid=66919) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1619.790577] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.790577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.790577] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.790890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.790890] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.790987] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.791093] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.791131] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.791297] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.791369] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.791458] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 is going to be updated. [ 1619.830793] env[66919]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66919) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1619.830939] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1619.831049] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1619.831257] env[66919]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1619.831394] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1619.846997] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: IN_PROGRESS for 2s [ 1621.857382] env[66919]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 477edf9b-362d-4dfc-a63d-98bae4607734 in Status: SUCCESS [ 1621.857849] env[66919]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 477edf9b-362d-4dfc-a63d-98bae4607734 deletion is rescheduled due to dependency. [ 1621.857849] env[66919]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-477edf9b-362d-4dfc-a63d-98bae4607734" {{(pid=66919) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1624.287740] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1624.288154] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1629.289523] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1629.290041] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1634.291139] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1634.291573] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1639.292197] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1639.292626] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1644.293908] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1644.294371] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1649.295391] env[66919]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1649.295791] env[66919]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0